00000001:02000400:2.0F:1787430609.342303:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_hostid 00000001:02000400:2.0:1787430624.314976:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787430625.507853:0:3227:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1079 MB/s 00000001:01000000:3.0F:1787430625.757845:0:3227:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1371 MB/s 00000001:01000000:2.0:1787430626.007417:0:3227:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5815 MB/s 00000020:02000000:3.0:1787430626.437868:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_63_g4e64706 00000400:02000000:0.0:1787430626.955723:0:3291:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.160@tcp [8/256/0/180] 00008000:02000000:1.0F:1787430629.909654:0:3441:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787430662.739967:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787430669.253461:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787430669.253468:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787430669.253600:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000098aa307a 00000080:02000400:3.0:1787430669.253612:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787430669.261086:0:5818:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787430669.261101:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787430669.261309:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000745d1d6b) 00000020:00000080:2.0:1787430669.261672:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787430669.280425:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787430669.281034:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787430669.316306:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787430669.316643:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787430669.316666:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787430669.316717:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787430669.316745:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787430669.317758:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787430669.317767:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787430669.317780:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68a36 00000020:01000004:1.0:1787430669.317787:0:5818:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787430669.317792:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787430669.317797:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000098aa307a from MGS 00000020:01000004:1.0:1787430669.317801:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787430669.317820:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009a3460da) 00000020:00000080:1.0:1787430669.317833:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787430669.317933:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000098aa307a from MGS, refs=2 00080000:01000000:1.0:1787430669.317940:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787430669.317946:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68a44 00000100:00100000:1.0:1787430669.318280:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787430669.318647:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787430669.318654:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787430669.319721:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787430669.319730:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787430669.320847:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430669.321024:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787430669.321029:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787430669.321865:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787430669.321874:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787430669.322311:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787430669.322318:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787430669.323286:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430669.323291:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430669.323293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430669.323743:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430669.323745:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430669.323747:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430669.324290:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787430669.325470:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787430669.573521:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5151 MB/s 00000001:01000000:3.0:1787430669.823462:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4619 MB/s 00000001:01000000:3.0:1787430670.073958:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 851 MB/s 00000001:01000000:3.0:1787430670.323909:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1203 MB/s 00080000:10000000:3.0:1787430670.328988:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1787430670.338000:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787430670.338018:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787430670.338022:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787430670.340490:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787430670.340572:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787430670.340625:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787430670.340892:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787430670.340917:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787430670.341221:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430670.343499:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787430670.343509:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787430670.345695:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787430670.345707:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787430670.346012:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787430670.346018:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787430670.346625:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787430670.346645:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.160@tcp' 00000020:01000004:2.0:1787430670.346647:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787430670.346695:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.160@tcp (typ=mgc) 00000020:00000080:2.0:1787430670.346707:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.160@tcp (00000000bf603932) 00000020:00000080:2.0:1787430670.346730:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787430670.346821:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000099db50a8@MGC192.168.204.160@tcp: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787430670.346970:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.160@tcp-0 is initialized 00000040:01000000:2.0:1787430670.346975:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787430670.347206:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787430670.348129:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787430670.348198:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.160@tcp (uuid 839a7a74-1b4a-4cd3-9548-e5ffe194716c) 00000020:00000080:2.0:1787430670.348217:0:5818:0:(genops.c:1385:class_connect()) connect: client 839a7a74-1b4a-4cd3-9548-e5ffe194716c, cookie 0x1fa5b1e070e68a52 00000100:00080000:2.0:1787430670.348228:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430670.348234:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import 0000000099db50a8 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787430670.348279:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a430adc3 x1874256856088704/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430670.348305:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS 00000020:01000004:2.0:1787430670.348322:0:5818:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787430670.348374:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787430670.348385:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000078a9882c) 00000020:00000080:2.0:1787430670.348397:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787430670.352730:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a430adc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3306:1874256856088704:0@lo:250: 00000100:00100000:1.0:1787430670.352828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430670.352974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856088704 00000100:00100000:1.0:1787430670.352982:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856088704 00000100:00100000:1.0:1787430670.353011:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430670.353018:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032c471de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1874256856088704:12345-0@lo:250: 00010000:00080000:1.0:1787430670.353043:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 839a7a74-1b4a-4cd3-9548-e5ffe194716c@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:1.0:1787430670.353090:0:5830:0:(genops.c:1385:class_connect()) connect: client 839a7a74-1b4a-4cd3-9548-e5ffe194716c, cookie 0x1fa5b1e070e68a60 00000100:00080000:1.0:1787430670.353254:0:5830:0:(import.c:65:import_set_state_nolock()) 000000001d7eddf0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430670.353305:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032c471de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:3306:x1874256856088704:12345-0@lo:250: Request processed in 286us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430670.353313:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430670.353615:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787430670.353624:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:1.0:1787430670.353632:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787430670.353637:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787430670.353640:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000099db50a8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787430670.353643:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787430670.353651:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787430670.353655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a430adc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3306:1874256856088704:0@lo:250: 00000100:00100000:2.0:1787430670.362651:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430670.362877:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787430670.362885:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00010000:00010000:2.0:1787430670.366041:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430670.366118:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787430670.366129:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787430670.366661:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787430670.366668:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787430670.367556:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430670.367748:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787430670.367753:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787430670.368211:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787430670.368218:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787430670.395896:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430670.396159:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787430670.396167:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787430670.397221:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787430670.397230:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787430670.399283:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430670.399509:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787430670.399515:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787430670.400929:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787430670.400940:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787430670.401851:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430670.402105:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787430670.402111:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787430670.402881:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787430670.402888:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787430670.403758:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430670.403909:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787430670.403914:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787430670.404750:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787430670.404758:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787430670.426686:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430670.426895:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787430670.426902:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787430670.430310:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787430670.430600:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787430670.431873:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787430670.431884:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787430670.434284:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787430670.434311:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787430670.434317:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787430670.434709:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787430670.434745:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787430670.434749:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787430670.434755:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430670.434756:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430670.434757:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430670.434758:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430670.434760:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430670.434761:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430670.434762:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430670.434763:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430670.434764:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430670.434765:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430670.434766:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787430670.434768:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787430670.434770:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430670.434771:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430670.434773:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430670.434773:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430670.434774:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430670.434775:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430670.434776:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430670.434777:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430670.434778:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430670.434778:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430670.434779:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430670.434780:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787430670.434825:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787430670.434843:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cae6299b pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856088832:0@lo:253: 00000100:00100000:0.0:1787430670.434918:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.435040:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000110847aa going to sleep for 11 seconds 00000100:00100000:1.0:1787430670.435153:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856088832 00000100:00100000:1.0:1787430670.435160:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856088832 00000100:00100000:1.0:1787430670.435316:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430670.435364:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095284c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:5818:x1874256856088832:12345-0@lo:253: 20000000:01000000:1.0:1787430670.435425:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787430670.435429:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787430670.435885:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787430670.435954:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787430670.436665:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430670.437561:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787430670.437887:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430670.437892:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787430670.437898:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787430670.437901:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787430670.437918:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787430670.438680:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430670.438871:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787430670.438885:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787430670.438923:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787430670.438962:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787430670.439004:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787430670.439078:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787430670.439085:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787430670.439121:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787430670.439127:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787430670.439151:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787430670.439157:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787430670.439179:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787430670.439215:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787430670.439239:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787430670.439243:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787430670.439252:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430670.439652:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787430670.439662:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787430670.439692:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787430670.439718:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787430670.439753:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787430670.439764:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787430670.439822:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787430670.439830:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787430670.439879:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787430670.439919:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787430670.439945:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787430670.439954:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787430670.440024:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787430670.440032:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787430670.440056:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787430670.440083:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787430670.440212:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787430670.440252:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787430670.440258:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787430670.440872:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787430670.441628:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787430670.441657:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.160@tcp for mdt 20000000:01000000:1.0:1787430670.441660:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.160@tcp (null) (null) (null) 00000040:00080000:1.0:1787430670.441697:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787430670.441705:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787430670.441736:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787430670.441743:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.160@tcp (null) (null) 00000040:00080000:1.0:1787430670.441786:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787430670.441795:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787430670.441823:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787430670.441856:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787430670.441922:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787430670.441926:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787430670.441931:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787430670.441938:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787430670.444909:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787430670.446700:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787430670.458178:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787430670.458637:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787430670.458759:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787430670.458793:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787430670.458797:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787430670.458801:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787430670.458817:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787430670.458819:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787430670.458860:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787430670.458862:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787430670.462473:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787430670.463017:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787430670.463086:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787430670.463173:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1787430670.463198:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787430670.463317:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787430670.464703:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787430670.465279:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787430670.465372:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787430670.465423:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787430670.465438:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787430670.465440:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787430670.465447:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787430670.465737:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465757:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465769:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465776:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465783:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465790:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465796:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000db033e8 already unused, calling callback (00000000f78cf825) 00010000:00010000:2.0:1787430670.465800:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465807:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465839:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465848:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.465854:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787430670.465872:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787430670.618853:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095284c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:5818:x1874256856088832:12345-0@lo:253: Request processed in 183520us (183926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430670.618874:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430670.619038:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cae6299b pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856088832:0@lo:253: 10000000:01000000:0.0:1787430670.619054:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787430670.619057:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787430670.619060:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430670.619061:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430670.619062:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787430670.619063:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430670.619064:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430670.619066:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430670.619067:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430670.619069:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787430670.619070:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430670.619071:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787430670.619088:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000098aa307a from lustre-MDT0000 10000000:01000000:0.0:1787430670.619113:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787430670.619115:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787430670.619120:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0f2c3458000 10000000:01000000:0.0:1787430670.619124:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430670.619131:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0f2c3458000 from 1 10000000:01000000:0.0:1787430670.619133:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787430670.619168:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.619178:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.619187:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430670.619204:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cae6299b pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856088960:0@lo:101: 00000100:00100000:0.0:1787430670.619237:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.619436:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a7ad965 going to sleep for 11 seconds 00000100:00100000:1.0:1787430670.619522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856088960 00000100:00100000:1.0:1787430670.619529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856088960 00000100:00100000:1.0:1787430670.619570:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430670.619578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be309a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:5818:x1874256856088960:12345-0@lo:101: 00010000:00010000:1.0:1787430670.619590:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430670.619604:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000794bbee4/0x1fa5b1e070e68a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68a6e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430670.619624:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000794bbee4/0x1fa5b1e070e68a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430670.619643:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000794bbee4/0x1fa5b1e070e68a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430670.619651:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000794bbee4, rc 0) 00000100:00100000:1.0:1787430670.619695:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be309a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:5818:x1874256856088960:12345-0@lo:101: Request processed in 118us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430670.619700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430670.619776:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cae6299b pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856088960:0@lo:101: 00010000:00010000:3.0:1787430670.619788:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.619796:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.619862:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089088:0@lo:501: 00000100:00100000:3.0:1787430670.619921:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.619944:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f713991f going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.620000:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089088 00000100:00100000:0.0:1787430670.620005:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089088 00000100:00100000:0.0:1787430670.620033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430670.620038:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002048e6cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:5818:x1874256856089088:12345-0@lo:501: 00000100:00100000:0.0:1787430670.620251:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002048e6cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:5818:x1874256856089088:12345-0@lo:501: Request processed in 213us (330us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430670.620259:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430670.620367:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089088:0@lo:501: 10000000:01000000:3.0:1787430670.620392:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787430670.620403:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620411:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 00000000597bf3e8/0x1fa5b1e070e68a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430670.620417:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0f2d0492800 10000000:01000000:3.0:1787430670.620422:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787430670.620426:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0f2d0492800 10000000:01000000:3.0:1787430670.620428:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787430670.620431:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0f2d0492800 from 1 10000000:01000000:3.0:1787430670.620433:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787430670.620449:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620455:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620462:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.620472:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089216:0@lo:101: 00000100:00100000:3.0:1787430670.620504:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.620521:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f713991f going to sleep for 11 seconds 00000100:00100000:2.0:1787430670.620593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089216 00000100:00100000:2.0:1787430670.620599:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089216 00000100:00100000:2.0:1787430670.620623:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787430670.620629:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064bbe7ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:5818:x1874256856089216:12345-0@lo:101: 00010000:00010000:2.0:1787430670.620639:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430670.620651:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68a7c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.620669:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a7c expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.620677:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000db033e8/0x1fa5b1e070e68a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a7c expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.620684:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000db033e8, rc 0) 00000100:00100000:2.0:1787430670.620725:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064bbe7ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+7:5818:x1874256856089216:12345-0@lo:101: Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430670.620737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430670.620754:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089216:0@lo:101: 00010000:00010000:3.0:1787430670.620766:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620774:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430670.620785:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787430670.620801:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620807:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 00000000366dbf23/0x1fa5b1e070e68a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430670.620813:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787430670.620816:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430670.620819:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0f2d0492800 10000000:01000000:3.0:1787430670.620822:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787430670.620824:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787430670.620826:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787430670.620837:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620844:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.620850:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.620867:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089344:0@lo:101: 00000100:00100000:3.0:1787430670.620891:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.620917:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f713991f going to sleep for 11 seconds 00000100:00100000:1.0:1787430670.621057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089344 00000100:00100000:1.0:1787430670.621062:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089344 00000100:00100000:1.0:1787430670.621126:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430670.621133:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000413311f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+7:5818:x1874256856089344:12345-0@lo:101: 00010000:00010000:1.0:1787430670.621140:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430670.621147:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004af5d04d/0x1fa5b1e070e68a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68a8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430670.621162:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004af5d04d/0x1fa5b1e070e68a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430670.621170:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004af5d04d/0x1fa5b1e070e68a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430670.621176:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004af5d04d, rc 0) 00000100:00100000:1.0:1787430670.621216:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000413311f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+8:5818:x1874256856089344:12345-0@lo:101: Request processed in 84us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430670.621222:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430670.621275:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089344:0@lo:101: 00010000:00010000:3.0:1787430670.621283:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.621290:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.621323:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089472:0@lo:501: 00000100:00100000:3.0:1787430670.621390:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.621576:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f713991f going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.621646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089472 00000100:00100000:0.0:1787430670.621651:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089472 00000100:00100000:0.0:1787430670.621672:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430670.621677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ef8013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+8:5818:x1874256856089472:12345-0@lo:501: 00000100:00100000:0.0:1787430670.621868:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ef8013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5818:x1874256856089472:12345-0@lo:501: Request processed in 190us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.621875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430670.621962:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089472:0@lo:501: 00000100:00100000:3.0:1787430670.621990:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089600:0@lo:503: 00000100:00100000:3.0:1787430670.622027:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.622048:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f713991f going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.622162:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089600 00000100:00100000:0.0:1787430670.622167:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089600 00000100:00100000:0.0:1787430670.622185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430670.622190:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5177e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5818:x1874256856089600:12345-0@lo:503: 00000100:00100000:0.0:1787430670.622361:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5177e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5818:x1874256856089600:12345-0@lo:503: Request processed in 171us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.622368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430670.622439:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089600:0@lo:503: 00000100:00100000:3.0:1787430670.623028:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5860:1874256856089728:0@lo:502: 00000100:00100000:3.0:1787430670.623066:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.623138:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000abacf8a2 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.623176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089728 00000100:00100000:0.0:1787430670.623181:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089728 00000100:00100000:0.0:1787430670.623248:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787430670.623256:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000454b1ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5860:x1874256856089728:12345-0@lo:502: 00000100:00100000:0.0:1787430670.623461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000454b1ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5860:x1874256856089728:12345-0@lo:502: Request processed in 205us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.623477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430670.623577:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5860:1874256856089728:0@lo:502: 00000020:01000000:3.0:1787430670.623598:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430670.623608:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430670.623615:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787430670.623621:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787430670.623623:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430670.623641:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f10158fd) 00000020:00000080:3.0:1787430670.623658:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787430670.623664:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787430670.623767:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787430670.623774:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68a9f 00000020:00000080:3.0:1787430670.624014:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787430670.624020:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430670.624023:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430670.624024:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787430670.624027:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430670.624030:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430670.624031:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787430670.624034:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430670.624039:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006e3768d2) 00000020:00000080:3.0:1787430670.624047:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787430670.624050:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787430670.624052:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787430670.624054:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787430670.624058:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787430670.624095:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000098aa307a from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787430670.624104:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d49cd488) 00000020:00000080:3.0:1787430670.624110:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787430670.624175:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787430670.624180:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e68ab4 00000020:00000080:3.0:1787430670.624264:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787430670.624269:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787430670.624273:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1fa5b1e070e68abb 00080000:01000000:3.0:1787430670.624278:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787430670.624281:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68ac2 00080000:10000000:3.0:1787430670.624658:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787430670.624857:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787430670.628398:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787430670.690437:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787430670.691193:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787430670.694679:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787430670.695292:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787430670.721860:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d50cc1f8) 00000020:00000080:0.0:1787430670.721884:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787430670.721985:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787430670.721992:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68ad0 00000020:00000080:1.0:1787430670.722733:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787430670.727533:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.775103:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.807611:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.834408:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.866366:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.890725:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787430670.919306:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1fa5b1e070e68ad7 00000020:00000080:1.0:1787430670.919758:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787430670.919776:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430670.919782:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430670.919785:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787430670.919788:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430670.919794:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430670.919795:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787430670.919800:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787430670.919840:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787430670.919855:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430670.919858:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430670.919860:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787430670.919862:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430670.919865:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430670.919866:0:5860:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787430670.919869:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430670.919870:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787430670.919924:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee85028d pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5860:1874256856089856:0@lo:502: 00000100:00100000:1.0:1787430670.920114:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430670.920176:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000043013daa going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.920231:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089856 00000100:00100000:0.0:1787430670.920239:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089856 00000100:00100000:0.0:1787430670.920287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430670.920296:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf73d523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5860:x1874256856089856:12345-0@lo:502: 00000100:00100000:0.0:1787430670.920713:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf73d523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5860:x1874256856089856:12345-0@lo:502: Request processed in 417us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.920721:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430670.920942:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee85028d pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5860:1874256856089856:0@lo:502: 00000020:01000000:1.0:1787430670.920967:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430670.920974:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430670.920976:0:5860:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787430670.920979:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787430670.921203:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787430670.921224:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787430670.921244:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.921256:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 0000000008c5e7cd/0x1fa5b1e070e68a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430670.921262:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f2d0492800 from 1 10000000:01000000:0.0:1787430670.921265:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787430670.921299:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.921307:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.921315:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430670.921383:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089984:0@lo:101: 00000100:00100000:0.0:1787430670.921418:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.921440:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4701ed1 going to sleep for 11 seconds 00000100:00100000:3.0:1787430670.921517:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856089984 00000100:00100000:3.0:1787430670.921532:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856089984 00000100:00100000:3.0:1787430670.921566:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430670.921573:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005533b4b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5818:x1874256856089984:12345-0@lo:101: 00010000:00010000:3.0:1787430670.921583:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430670.921596:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68ade expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.921614:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.921623:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.921631:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002390aeef, rc 0) 00000100:00100000:3.0:1787430670.921658:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005533b4b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5818:x1874256856089984:12345-0@lo:101: Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430670.921663:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430670.921788:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856089984:0@lo:101: 00010000:00010000:0.0:1787430670.921800:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.921807:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430670.922411:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090112:0@lo:256: 00000100:00100000:0.0:1787430670.922451:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.922478:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4701ed1 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.922496:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090112 00000100:00100000:0.0:1787430670.922500:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090112 00000100:00100000:0.0:1787430670.922535:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430670.922541:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052e81e8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5818:x1874256856090112:12345-0@lo:256: 20000000:01000000:0.0:1787430670.922557:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787430670.922563:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787430670.922627:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052e81e8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5818:x1874256856090112:12345-0@lo:256: Request processed in 87us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.922642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430670.922677:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090112:0@lo:256: 10000000:01000000:0.0:1787430670.923267:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430670.923276:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923285:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430670.923293:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2d0492800 from 1 10000000:01000000:0.0:1787430670.923295:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430670.923317:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923323:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923364:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430670.923379:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090240:0@lo:101: 00000100:00100000:0.0:1787430670.923411:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.923439:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4701ed1 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.923458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090240 00000100:00100000:0.0:1787430670.923463:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090240 00000100:00100000:0.0:1787430670.923484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430670.923490:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006459286e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5818:x1874256856090240:12345-0@lo:101: 00010000:00010000:0.0:1787430670.923499:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430670.923516:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68aec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923534:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923544:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923551:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4363f02, rc 0) 00000100:00100000:0.0:1787430670.923581:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006459286e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856090240:12345-0@lo:101: Request processed in 92us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.923587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430670.923617:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090240:0@lo:101: 00010000:00010000:0.0:1787430670.923626:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.923632:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430670.923673:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090368:0@lo:501: 00000100:00100000:0.0:1787430670.923695:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.923707:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4701ed1 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.923718:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090368 00000100:00100000:0.0:1787430670.923722:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090368 00000100:00100000:0.0:1787430670.923737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430670.923742:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bdf9f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856090368:12345-0@lo:501: 00000100:00100000:0.0:1787430670.924906:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bdf9f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856090368:12345-0@lo:501: Request processed in 1160us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.924925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430670.925096:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0baf44f pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090368:0@lo:501: 00000100:00100000:2.0:1787430670.925139:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090496:0@lo:503: 00000100:00100000:2.0:1787430670.925180:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430670.925246:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6b6ac42 going to sleep for 11 seconds 00000100:00100000:3.0:1787430670.925295:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090496 00000100:00100000:3.0:1787430670.925301:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090496 00000100:00100000:3.0:1787430670.925412:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430670.925420:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090f4cfc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856090496:12345-0@lo:503: 00000040:00080000:3.0:1787430670.925458:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787430670.925505:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090f4cfc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856090496:12345-0@lo:503: Request processed in 86us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430670.925516:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430670.925661:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090496:0@lo:503: 00000040:00080000:0.0:1787430670.926647:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787430670.926921:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787430670.926938:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430670.926989:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.927066:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430670.927127:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787430670.927130:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0f2d0492800 10000000:01000000:2.0:1787430670.927133:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0f2d0492800 10000000:01000000:2.0:1787430670.927137:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430670.927141:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2d0492800 from 1 10000000:01000000:2.0:1787430670.927144:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787430670.927179:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.927186:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.927195:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430670.927224:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090624:0@lo:101: 00000100:00100000:2.0:1787430670.927275:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430670.927314:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7d0c663 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.927416:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090624 00000100:00100000:0.0:1787430670.927422:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090624 00000100:00100000:0.0:1787430670.927461:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430670.927468:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045608602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856090624:12345-0@lo:101: 00010000:00010000:0.0:1787430670.927480:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430670.927490:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052acfa66/0x1fa5b1e070e68b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68afa expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.927509:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052acfa66/0x1fa5b1e070e68b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.927517:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052acfa66/0x1fa5b1e070e68b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.927594:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052acfa66, rc 0) 00000100:00100000:0.0:1787430670.927630:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045608602 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5818:x1874256856090624:12345-0@lo:101: Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.927636:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430670.927753:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090624:0@lo:101: 00010000:00010000:2.0:1787430670.927766:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430670.927774:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430670.927822:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090752:0@lo:501: 00000100:00100000:2.0:1787430670.927847:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430670.927874:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7d0c663 going to sleep for 11 seconds 00000100:00100000:3.0:1787430670.927916:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090752 00000100:00100000:3.0:1787430670.927920:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090752 00000100:00100000:3.0:1787430670.927951:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787430670.927958:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007582b8eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5818:x1874256856090752:12345-0@lo:501: 00000100:00100000:3.0:1787430670.928252:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007582b8eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5818:x1874256856090752:12345-0@lo:501: Request processed in 295us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430670.928260:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430670.928377:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090752:0@lo:501: 00000100:00100000:2.0:1787430670.928402:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090880:0@lo:503: 00000100:00100000:2.0:1787430670.928436:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430670.928459:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7d0c663 going to sleep for 11 seconds 00000100:00100000:3.0:1787430670.928605:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856090880 00000100:00100000:3.0:1787430670.928609:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856090880 00000100:00100000:3.0:1787430670.928640:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430670.928645:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ec5b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5818:x1874256856090880:12345-0@lo:503: 00000100:00100000:3.0:1787430670.928931:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ec5b3e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5818:x1874256856090880:12345-0@lo:503: Request processed in 285us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430670.928938:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430670.929104:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856090880:0@lo:503: 00000100:00100000:2.0:1787430670.929475:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5865:1874256856091008:0@lo:502: 00000100:00100000:2.0:1787430670.929514:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430670.929645:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000534ead24 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.929786:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091008 00000100:00100000:0.0:1787430670.929792:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091008 00000100:00100000:0.0:1787430670.929863:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430670.929871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000beb5f50a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5865:x1874256856091008:12345-0@lo:502: 00000100:00100000:0.0:1787430670.930184:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000beb5f50a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5865:x1874256856091008:12345-0@lo:502: Request processed in 313us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.930192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430670.930265:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5865:1874256856091008:0@lo:502: 00000020:01000004:2.0:1787430670.930321:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787430670.930372:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000040a97287) 00000020:00000080:2.0:1787430670.930396:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787430670.930474:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000098aa307a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787430670.930478:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000098aa307a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787430670.930480:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000098aa307a 4 00010000:00080000:2.0:1787430670.930509:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000015c88d77@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787430670.932220:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787430670.932463:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787430670.932495:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787430670.932508:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1fa5b1e070e68b0f 00000100:00080000:2.0:1787430670.932518:0:5865:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430670.932523:0:5865:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015c88d77 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787430670.932556:0:5865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002e92b299 x1874256856091136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787430670.932577:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787430670.934658:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856091136:0@lo:38: 00000100:00100000:1.0:1787430670.934758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430670.934842:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091136 00000100:00100000:1.0:1787430670.934851:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091136 00000100:00100000:1.0:1787430670.934884:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430670.934892:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee85028d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1874256856091136:12345-0@lo:38: 00000100:00100000:1.0:1787430670.934958:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee85028d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1874256856091136:12345-0@lo:38: Request processed in 65us (201us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787430670.934965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430670.935010:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430670.935020:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000015c88d77 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787430670.935025:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787430670.935029:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e92b299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856091136:0@lo:38: 00000100:00100000:1.0:1787430670.935169:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7ee0cfa pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5865:1874256856091264:0@lo:502: 00000100:00100000:1.0:1787430670.935213:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430670.935240:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091264 00000100:00100000:1.0:1787430670.935244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091264 00000100:00100000:3.0:1787430670.935301:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787430670.935310:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bb7a691 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5865:x1874256856091264:12345-0@lo:502: 00000100:00100000:3.0:1787430670.935559:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bb7a691 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5865:x1874256856091264:12345-0@lo:502: Request processed in 251us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430670.935567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787430670.935830:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2098aaa going to sleep for 11 seconds 00000100:00100000:1.0:1787430670.935846:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7ee0cfa pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5865:1874256856091264:0@lo:502: 00000040:00080000:1.0:1787430670.935871:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787430670.936779:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787430670.936814:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430670.936873:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.936886:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 000000001a89cf74/0x1fa5b1e070e68afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787430670.936932:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787430670.936934:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430670.936935:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430670.936937:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430670.936938:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430670.936940:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430670.936941:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430670.936943:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430670.936944:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430670.936945:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430670.936947:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430670.936948:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430670.936953:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787430670.936956:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430670.936957:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430670.936958:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430670.936959:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430670.936960:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430670.936961:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430670.936963:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430670.936964:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430670.936965:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430670.936966:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430670.936967:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430670.936968:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430670.936989:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787430670.937013:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007eaec6e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856091392:0@lo:253: 00000100:00100000:0.0:1787430670.937064:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430670.937101:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cb15bdb going to sleep for 11 seconds 00000100:00100000:2.0:1787430670.937205:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091392 00000100:00100000:2.0:1787430670.937211:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091392 00000100:00100000:2.0:1787430670.937262:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430670.937271:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c03fa124 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5818:x1874256856091392:12345-0@lo:253: 20000000:01000000:2.0:1787430670.937298:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787430670.937313:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787430670.963072:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787430670.963100:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787430670.963153:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787430670.963157:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787430670.963179:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.963200:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.963219:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.963260:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.963272:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 12 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.963287:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874256856091520:0@lo:104: 00000100:00100000:3.0:1787430670.963394:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.963438:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042d7ba64 going to sleep for 11 seconds 00000100:00100000:0.0:1787430670.963732:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091520 00000100:00100000:0.0:1787430670.963741:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091520 00000100:00100000:0.0:1787430670.963792:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430670.963800:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062af6e05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5853:x1874256856091520:12345-0@lo:104: 00010000:00010000:0.0:1787430670.963812:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430670.963861:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430670.963866:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062af6e05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5853:x1874256856091520:12345-0@lo:104: Request processed in 67us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430670.963873:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787430670.964129:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430670.964134:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964142:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aedd603a already unused, calling callback (0000000016f63ebf) 10000000:00010000:3.0:1787430670.964146:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964153:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430670.964160:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430670.964165:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430670.964194:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964212:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430670.964230:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964236:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: 00000000aedd603a/0x1fa5b1e070e68ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ae5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964251:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430670.964253:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430670.964254:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430670.964375:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df463fb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856091648:0@lo:103: 00000100:00100000:3.0:1787430670.964407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430670.964476:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091648 00000100:00100000:3.0:1787430670.964480:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091648 00010000:00010000:3.0:1787430670.964496:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 13 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.964517:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430670.964536:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e23792a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3308:x1874256856091648:12345-0@lo:103: 00010000:00010000:3.0:1787430670.964546:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430670.964550:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 13 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964559:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 13 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964574:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964591:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787430670.964603:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001447111s 00010000:00010000:3.0:1787430670.964607:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964613:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964618:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964623:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964628:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072e1ab5f already unused, calling callback (00000000f78cf825) 00010000:00010000:3.0:1787430670.964631:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964637:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964644:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964653:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430670.964678:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e23792a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3308:x1874256856091648:12345-0@lo:103: Request processed in 156us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430670.964684:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787430670.964724:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68ade expref: 12 pid: 5831 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.964733:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874256856091520:0@lo:104: 00010000:00010000:3.0:1787430670.964747:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964755:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964759:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430670.964764:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072e1ab5f/0x1fa5b1e070e68b16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430670.964784:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df463fb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856091648:0@lo:103: 00000100:00100000:1.0:1787430670.973635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c03fa124 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5818:x1874256856091392:12345-0@lo:253: Request processed in 36357us (36561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430670.973653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787430670.973813:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007eaec6e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5818:1874256856091392:0@lo:253: 10000000:01000000:0.0:1787430670.973830:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787430670.973834:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787430670.973836:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430670.973837:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430670.973839:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430670.973840:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430670.973842:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430670.973843:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430670.973845:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430670.973846:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430670.973848:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430670.973850:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430670.973851:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787430670.973867:0:5818:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787430670.978498:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787430670.978935:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787430670.979135:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787430670.979294:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787430670.979665:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787430670.979824:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787430670.980975:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.981155:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787430670.981670:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.981830:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787430670.982008:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430670.982207:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787430671.019905:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787430671.047375:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787430671.047602:0:5870:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787430671.047606:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787430671.047751:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787430671.050823:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787430671.051018:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787430671.051765:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787430671.051774:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787430671.051916:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430671.053037:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787430671.058726:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787430671.064676:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787430671.064949:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787430671.065118:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787430671.067721:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787430671.067899:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787430671.068040:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787430671.068176:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787430671.068321:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787430671.068506:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787430671.068643:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787430671.068797:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787430671.068931:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787430671.069074:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787430671.069211:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787430671.069411:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787430671.069549:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787430671.069696:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787430671.069831:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787430671.069987:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787430671.070250:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787430671.071442:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787430671.071593:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787430671.071743:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787430671.071876:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787430671.072041:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787430671.072140:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787430671.072242:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787430671.072375:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787430671.072543:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787430671.072697:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787430671.072838:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787430671.072988:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787430671.073153:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787430671.073741:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787430671.073900:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787430671.074134:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787430671.086531:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787430671.126133:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787430671.126171:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc04f01d9b988 00100000:10000000:2.0:1787430671.126178:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787430671.126637:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787430671.126655:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787430671.126670:0:5818:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787430671.126686:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787430671.158215:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787430671.158288:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787430671.158293:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787430671.388921:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430672.412476:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430673.436447:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430673.782303:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787430674.461103:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430675.484939:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430676.189269:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787430676.189279:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787430676.189282:0:471:0:(import.c:65:import_set_state_nolock()) 0000000015c88d77 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430676.189293:0:471:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015c88d77 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787430676.189315:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8df3e68 x1874256856091904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787430676.189370:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8df3e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856091904:0@lo:38: 00000100:00100000:3.0:1787430676.189454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430676.189697:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f57c7ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856091776:0@lo:400: 00000100:00100000:1.0:1787430676.189761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430676.189816:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091776 00000100:00100000:2.0:1787430676.189824:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091776 00000100:00100000:0.0:1787430676.189831:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856091904 00000100:00100000:0.0:1787430676.189837:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856091904 00000100:00100000:0.0:1787430676.189877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430676.189884:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df463fb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874256856091904:12345-0@lo:38: 00010000:00080000:0.0:1787430676.189909:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:0.0:1787430676.189943:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1fa5b1e070e68b1d 00000004:00100000:0.0:1787430676.189986:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787430676.190082:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787430676.190092:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006165be75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:3309:x1874256856091776:12345-0@lo:400: 00000100:00100000:2.0:1787430676.190618:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006165be75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:3309:x1874256856091776:12345-0@lo:400: Request processed in 527us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430676.190627:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787430676.190632:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000e5d43a35 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430676.190839:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f57c7ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856091776:0@lo:400: 00000100:00100000:0.0:1787430676.190905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df463fb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874256856091904:12345-0@lo:38: Request processed in 1018us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430676.190912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787430676.190969:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a8df3e68 x1874256856091904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787430676.190986:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787430676.190996:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787430676.191000:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787430676.191003:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000015c88d77 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430676.191010:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8df3e68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856091904:0@lo:38: 00010000:00010000:2.0:1787430676.510018:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787430677.347650:0:6315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3deb1940 20000000:00000080:2.0:1787430677.347766:0:6315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f2d8baf800 uarg=0000000000000000 20000000:01000000:2.0:1787430677.347814:0:6315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787430677.347823:0:6315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787430677.347830:0:6315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787430677.348085:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787430677.348174:0:6315:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787430677.352686:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430677.353168:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787430677.353236:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787430677.353286:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787430677.353304:0:6315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787430677.353323:0:6315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430677.353392:0:6315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430677.353456:0:6315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430677.353497:0:6315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430677.353512:0:6315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 10 pid: 5832 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430677.353526:0:6315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008926822b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1874256856092032:0@lo:104: 00000100:00100000:2.0:1787430677.353584:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430677.353724:0:6315:0:(client.c:2715:ptlrpc_set_wait()) set 000000005069d201 going to sleep for 11 seconds 00000100:00100000:3.0:1787430677.353784:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092032 00000100:00100000:3.0:1787430677.353791:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092032 00000100:00100000:3.0:1787430677.353892:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430677.353904:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d713c36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:6315:x1874256856092032:12345-0@lo:104: 00010000:00010000:3.0:1787430677.353926:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430677.353988:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430677.353994:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d713c36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:6315:x1874256856092032:12345-0@lo:104: Request processed in 93us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430677.354001:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430677.354059:0:6315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008926822b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1874256856092032:0@lo:104: 00010000:00010000:2.0:1787430677.354077:0:6315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430677.354731:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430677.354741:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430677.354751:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006529b283 already unused, calling callback (0000000016f63ebf) 10000000:00010000:1.0:1787430677.354754:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430677.354762:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430677.354769:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430677.354774:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430677.354823:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430677.354830:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430677.354849:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430677.354856:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: 000000006529b283/0x1fa5b1e070e68aec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68af3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430677.354889:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430677.354891:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430677.354892:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430677.354907:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7ee0cfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856092160:0@lo:103: 00000100:00100000:1.0:1787430677.355235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430677.355694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092160 00000100:00100000:0.0:1787430677.355711:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092160 00010000:00010000:0.0:1787430677.355757:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 11 pid: 5832 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430677.355813:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430677.355823:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eefc54d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:3310:x1874256856092160:12345-0@lo:103: 00010000:00010000:0.0:1787430677.355840:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430677.355846:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 11 pid: 5832 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355860:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 11 pid: 5832 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355878:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4363f02/0x1fa5b1e070e68af3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68aec expref: 11 pid: 5832 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355897:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355906:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355924:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355930:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355937:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.355943:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.356100:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000086edc84 already unused, calling callback (00000000f78cf825) 00010000:00010000:0.0:1787430677.356115:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.356123:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.356138:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.356152:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430677.356248:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eefc54d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:3310:x1874256856092160:12345-0@lo:103: Request processed in 425us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430677.356256:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430677.356294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7ee0cfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856092160:0@lo:103: 00010000:00010000:0.0:1787430677.357407:0:6315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.357428:0:6315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430677.357435:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000086edc84/0x1fa5b1e070e68b24 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430677.533315:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430678.556864:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787430679.132683:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430679.132691:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f2d0492800 from 3 10000000:01000000:3.0:1787430679.132710:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430679.132752:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.132765:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.132776:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430679.132846:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092288:0@lo:101: 00000100:00100000:3.0:1787430679.132913:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430679.132957:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000437bab98 going to sleep for 11 seconds 00000100:00100000:3.0:1787430679.133014:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092288 00000100:00100000:3.0:1787430679.133021:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092288 00000100:00100000:3.0:1787430679.133060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787430679.133067:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e83474fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856092288:12345-0@lo:101: 00010000:00010000:3.0:1787430679.133078:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430679.133089:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68b2b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133124:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133133:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002390aeef/0x1fa5b1e070e68b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133143:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002390aeef, rc 0) 00000100:00100000:3.0:1787430679.133194:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e83474fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856092288:12345-0@lo:101: Request processed in 127us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430679.133201:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787430679.133254:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092288:0@lo:101: 00010000:00010000:3.0:1787430679.133266:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133273:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430679.133311:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092416:0@lo:256: 00000100:00100000:3.0:1787430679.133356:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430679.133373:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000437bab98 going to sleep for 11 seconds 00000100:00100000:3.0:1787430679.133383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092416 00000100:00100000:3.0:1787430679.133386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092416 00000100:00100000:3.0:1787430679.133403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430679.133407:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bf09f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856092416:12345-0@lo:256: 20000000:01000000:3.0:1787430679.133419:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787430679.133432:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787430679.133435:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787430679.133503:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bf09f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856092416:12345-0@lo:256: Request processed in 96us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430679.133509:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430679.133532:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092416:0@lo:256: 10000000:01000000:3.0:1787430679.133565:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430679.133576:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133583:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: 0000000072e1ab5f/0x1fa5b1e070e68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430679.133591:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430679.133593:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2d0492800 from 1 10000000:01000000:3.0:1787430679.133595:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430679.133613:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: 000000006535f846/0x1fa5b1e070e68b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133620:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: 000000006535f846/0x1fa5b1e070e68b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133627:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: 000000006535f846/0x1fa5b1e070e68b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430679.133639:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092544:0@lo:101: 00000100:00100000:3.0:1787430679.133663:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430679.133675:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000437bab98 going to sleep for 11 seconds 00000100:00100000:3.0:1787430679.133687:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092544 00000100:00100000:3.0:1787430679.133691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092544 00000100:00100000:3.0:1787430679.133711:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430679.133716:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a74ea29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856092544:12345-0@lo:101: 00010000:00010000:3.0:1787430679.133728:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430679.133738:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000216d78a6/0x1fa5b1e070e68b40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68b39 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133751:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000216d78a6/0x1fa5b1e070e68b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133759:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000216d78a6/0x1fa5b1e070e68b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133766:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000216d78a6, rc 0) 00000100:00100000:3.0:1787430679.133791:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a74ea29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856092544:12345-0@lo:101: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430679.133797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430679.133824:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092544:0@lo:101: 00010000:00010000:3.0:1787430679.133832:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: 000000006535f846/0x1fa5b1e070e68b39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430679.133838:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: 000000006535f846/0x1fa5b1e070e68b39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430679.133880:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092672:0@lo:501: 00000100:00100000:3.0:1787430679.133903:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430679.133914:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000437bab98 going to sleep for 11 seconds 00000100:00100000:3.0:1787430679.133924:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092672 00000100:00100000:3.0:1787430679.133927:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092672 00000100:00100000:3.0:1787430679.133945:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430679.133950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b445d24c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856092672:12345-0@lo:501: 00000100:00100000:3.0:1787430679.134219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b445d24c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856092672:12345-0@lo:501: Request processed in 268us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430679.134226:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430679.134258:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092672:0@lo:501: 00000100:00100000:3.0:1787430679.134286:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092800:0@lo:503: 00000100:00100000:3.0:1787430679.134319:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430679.134363:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000437bab98 going to sleep for 11 seconds 00000100:00100000:3.0:1787430679.134375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092800 00000100:00100000:3.0:1787430679.134379:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092800 00000100:00100000:3.0:1787430679.134398:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430679.134403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067616745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856092800:12345-0@lo:503: 00000100:00100000:3.0:1787430679.134529:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067616745 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856092800:12345-0@lo:503: Request processed in 124us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430679.134536:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430679.134604:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bc0d38c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856092800:0@lo:503: 00000100:00100000:1.0:1787430679.135109:0:6438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7ee0cfa pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6438:1874256856092928:0@lo:502: 00000100:00100000:1.0:1787430679.135146:0:6438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430679.135170:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856092928 00000100:00100000:1.0:1787430679.135174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856092928 00000100:00100000:1.0:1787430679.135210:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787430679.135215:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d582163d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6438:x1874256856092928:12345-0@lo:502: 00000100:00100000:1.0:1787430679.135316:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d582163d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6438:x1874256856092928:12345-0@lo:502: Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430679.135322:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787430679.135365:0:6438:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc6db924 going to sleep for 11 seconds 00000100:00100000:1.0:1787430679.135375:0:6438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7ee0cfa pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6438:1874256856092928:0@lo:502: 00000020:01000000:1.0:1787430679.135394:0:6438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430679.135402:0:6438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430679.135404:0:6438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787430679.135410:0:6438:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2d0492800 00000020:00000080:1.0:1787430679.135412:0:6438:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787430679.135865:0:6438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6438:1874256856093056:0@lo:502: 00000100:00100000:1.0:1787430679.135906:0:6438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430679.135937:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093056 00000100:00100000:1.0:1787430679.135942:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093056 00000100:00100000:1.0:1787430679.135972:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430679.135981:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6438:x1874256856093056:12345-0@lo:502: 00000100:00100000:1.0:1787430679.136114:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6438:x1874256856093056:12345-0@lo:502: Request processed in 134us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430679.136120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430679.136161:0:6438:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430679.136178:0:6438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6438:1874256856093056:0@lo:502: 00000020:01000000:1.0:1787430679.136213:0:6438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430679.136219:0:6438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430679.136221:0:6438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787430679.136226:0:6438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787430679.136292:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787430679.136313:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430679.136324:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430679.136358:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430679.581492:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430680.604515:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430681.308510:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856093312:0@lo:400: 00000100:00100000:0.0:1787430681.308574:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856093184:0@lo:400: 00000100:00100000:3.0:1787430681.308582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430681.310764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430681.310811:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093184 00000100:00100000:0.0:1787430681.310820:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093184 00000100:00100000:0.0:1787430681.310869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787430681.310931:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:3307:x1874256856093184:12345-0@lo:400: 00000100:00100000:0.0:1787430681.311009:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:3307:x1874256856093184:12345-0@lo:400: Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430681.311018:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430681.311043:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856093184:0@lo:400: 00000100:00100000:3.0:1787430681.311347:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093312 00000100:00100000:3.0:1787430681.311353:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093312 00000100:00100000:3.0:1787430681.311384:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430681.311391:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856093312:12345-0@lo:400: 00000100:00100000:3.0:1787430681.311436:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856093312:12345-0@lo:400: Request processed in 45us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430681.311443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787430681.313745:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0f2c9397480 x1874256856093312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430681.313770:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856093312:0@lo:400: 00010000:00010000:1.0:1787430681.632222:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787430681.804515:0:6681:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787430681.804525:0:6681:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787430681.804663:0:6681:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0f2c562b800 00000020:01000004:3.0:1787430681.804679:0:6681:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787430681.804690:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787430681.804703:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0f2ec253370) 00000020:00000080:3.0:1787430681.804718:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787430681.826222:0:6681:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787430681.826588:0:6681:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787430681.852726:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787430681.860845:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787430681.860881:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787430681.860939:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787430681.860967:0:6681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787430681.861410:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787430681.861420:0:6681:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787430681.861431:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1fa5b1e070e68b4e 00000020:01000004:3.0:1787430681.861440:0:6681:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787430681.861464:0:6681:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787430681.861468:0:6681:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787430681.861475:0:6681:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787430681.861480:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787430681.861499:0:6681:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0f2fe36b370) 00000020:00000080:3.0:1787430681.861581:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787430681.862920:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430681.863088:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787430681.863093:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787430681.867101:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787430681.867116:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787430681.869541:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787430681.869555:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787430681.879717:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430681.881165:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787430681.881176:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787430681.881953:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787430681.881962:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787430681.901726:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430681.901997:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787430681.902004:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787430681.904270:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787430681.904285:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787430681.906625:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787430681.906646:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787430681.911187:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430681.911783:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787430681.911791:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787430681.912679:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787430681.912689:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787430681.950440:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430681.950650:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787430681.950658:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787430681.951956:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787430681.951966:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787430681.952462:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787430681.952487:0:6681:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787430681.952494:0:6681:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787430681.968658:0:6681:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787430681.968694:0:6681:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787430681.968697:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787430681.968698:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787430681.968700:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430681.968700:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430681.968701:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430681.968702:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430681.968704:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430681.968705:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430681.968706:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430681.968708:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430681.968708:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787430681.968712:0:6681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787430681.968714:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430681.968715:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787430681.968715:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430681.968716:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430681.968717:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430681.968718:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430681.968719:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430681.968720:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430681.968720:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430681.968721:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430681.968722:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787430681.968747:0:6681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787430681.968768:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856093440:0@lo:253: 00000100:00100000:1.0:1787430681.968836:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430681.968941:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430681.969028:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093440 00000100:00100000:2.0:1787430681.969036:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093440 00000100:00100000:2.0:1787430681.969096:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430681.969107:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856093440:12345-0@lo:253: 20000000:01000000:2.0:1787430681.969156:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787430681.969160:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787430681.969165:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787430681.969168:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787430681.970121:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430681.970388:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787430681.970402:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787430681.970443:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787430681.970450:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787430681.970480:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787430681.970543:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787430681.970908:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787430681.970928:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.160@tcp 20000000:01000000:2.0:1787430681.970930:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.160@tcp (null) (null) (null) 00000040:00080000:2.0:1787430681.970967:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787430681.970975:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787430681.971029:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787430681.971045:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.160@tcp (null) (null) 00000040:00080000:2.0:1787430681.971081:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787430681.971090:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787430681.971122:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787430681.971197:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787430681.972316:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787430681.972426:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.160@tcp 20000000:01000000:3.0:1787430681.972429:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.160@tcp (null) (null) (null) 00000040:00080000:3.0:1787430681.972470:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787430681.972479:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787430681.972510:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787430681.972532:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.160@tcp (null) (null) 00000040:00080000:3.0:1787430681.972585:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787430681.972595:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787430681.972646:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787430681.972688:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787430681.972707:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787430681.972710:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787430681.972716:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787430681.972717:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787430681.972719:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787430681.972732:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787430681.972734:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787430681.972768:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787430681.972770:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787430681.973249:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787430681.973299:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787430681.973643:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787430681.973927:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787430681.973964:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787430681.974021:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787430681.974033:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787430681.974035:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787430681.974616:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1787430681.974661:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1787430681.974709:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787430681.974962:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787430681.975018:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787430681.975054:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787430681.975066:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787430681.975068:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787430681.975491:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787430681.975707:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787430681.975748:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787430681.975808:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1787430681.975824:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787430681.975844:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.975862:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.975882:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.975889:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.975896:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.975940:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.975954:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 12 pid: 5832 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430681.975969:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1874256856093568:0@lo:104: 00000100:00100000:3.0:1787430681.976043:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430681.976166:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.976175:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 12 pid: 5830 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430681.976183:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1874256856093696:0@lo:104: 00000100:00100000:3.0:1787430681.976206:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430681.976395:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.976405:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 12 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430681.976423:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1874256856093824:0@lo:104: 00000100:00100000:3.0:1787430681.976455:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430681.976523:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093568 00000100:00100000:1.0:1787430681.976531:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093568 00000100:00100000:1.0:1787430681.976566:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093696 00000100:00100000:1.0:1787430681.976569:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093696 00000100:00100000:1.0:1787430681.976583:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430681.976592:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:5830:x1874256856093568:12345-0@lo:104: 00010000:00010000:1.0:1787430681.976604:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976651:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430681.976658:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:5830:x1874256856093568:12345-0@lo:104: Request processed in 66us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430681.976665:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430681.976680:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430681.976687:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5830:x1874256856093696:12345-0@lo:104: 00010000:00010000:1.0:1787430681.976694:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976723:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430681.976734:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5830:x1874256856093696:12345-0@lo:104: Request processed in 48us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430681.976739:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787430681.976757:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430681.976763:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976770:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430681.976773:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976781:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430681.976788:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430681.976794:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430681.976819:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976825:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430681.976841:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976848:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976860:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430681.976863:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976878:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430681.976881:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976887:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430681.976893:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430681.976898:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430681.976910:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976915:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430681.976921:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976927:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68a91 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.976937:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430681.976939:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430681.976941:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430681.976960:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856094080:0@lo:103: 00000100:00100000:1.0:1787430681.976987:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430681.977015:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430681.977021:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856093952:0@lo:103: 00000100:00100000:1.0:1787430681.977051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430681.977080:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094080 00000100:00100000:1.0:1787430681.977084:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094080 00010000:00010000:1.0:1787430681.977102:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 13 pid: 5830 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430681.977119:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093952 00000100:00100000:1.0:1787430681.977122:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093952 00010000:00010000:1.0:1787430681.977150:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 14 pid: 5832 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430681.977163:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430681.977169:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3310:x1874256856094080:12345-0@lo:103: 00010000:00010000:1.0:1787430681.977179:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430681.977184:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 14 pid: 5830 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.977193:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 14 pid: 5830 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.977208:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430681.977236:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3310:x1874256856094080:12345-0@lo:103: Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430681.977242:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430681.977255:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430681.977260:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3310:x1874256856093952:12345-0@lo:103: 00010000:00010000:1.0:1787430681.977268:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430681.977272:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 13 pid: 5832 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.977291:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 13 pid: 5832 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.977300:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430681.977322:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3310:x1874256856093952:12345-0@lo:103: Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430681.977349:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430681.977380:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856093952:0@lo:103: 00000100:00100000:1.0:1787430681.977389:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856094080:0@lo:103: 00010000:00010000:2.0:1787430681.977453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430681.977535:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c784bc00 going to sleep for 11 seconds 00010000:00010000:3.0:1787430681.977548:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68afa expref: 12 pid: 5832 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430681.977560:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1874256856093568:0@lo:104: 00010000:00010000:3.0:1787430681.977568:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302044e00/0x1fa5b1e070e68a91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68a8a expref: 11 pid: 5830 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430681.977578:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1874256856093696:0@lo:104: 00000100:00100000:1.0:1787430681.977624:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856093824 00000100:00100000:1.0:1787430681.977628:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856093824 00000100:00100000:1.0:1787430681.977647:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430681.977653:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5830:x1874256856093824:12345-0@lo:104: 00010000:00010000:1.0:1787430681.977661:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430681.977753:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430681.977760:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5830:x1874256856093824:12345-0@lo:104: Request processed in 107us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430681.977766:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430681.977819:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1874256856093824:0@lo:104: 00010000:00010000:3.0:1787430681.977838:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430681.977941:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430681.977948:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430681.977954:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0030600 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430681.977957:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430681.977964:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430681.977972:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430681.977977:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430681.978104:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978112:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430681.978149:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978156:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030600/0x1fa5b1e070e68a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68a75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978171:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430681.978173:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430681.978175:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430681.978225:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430681.978236:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856094208:0@lo:103: 00000100:00100000:2.0:1787430681.978268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430681.978356:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094208 00000100:00100000:3.0:1787430681.978361:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094208 00010000:00010000:3.0:1787430681.978378:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 11 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430681.978399:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430681.978405:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:3308:x1874256856094208:12345-0@lo:103: 00010000:00010000:3.0:1787430681.978414:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430681.978419:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 11 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978428:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 11 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978438:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68a6e expref: 11 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978451:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978459:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978471:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978478:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978485:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978501:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978507:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430681.978511:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978519:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978541:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430681.978550:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430681.978581:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:3308:x1874256856094208:12345-0@lo:103: Request processed in 176us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430681.978587:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430681.978616:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856094208:0@lo:103: 00010000:00010000:2.0:1787430681.978671:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430681.978679:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430681.978685:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68b5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787430681.978705:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787430682.012958:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:6681:x1874256856093440:12345-0@lo:253: Request processed in 43843us (44111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.012974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787430682.013066:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856093440:0@lo:253: 10000000:01000000:1.0:1787430682.013082:0:6681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787430682.013085:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430682.013087:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787430682.013088:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430682.013089:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787430682.013091:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430682.013108:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430682.013110:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430682.013112:0:6681:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787430682.013113:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430682.013114:0:6681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787430682.013153:0:6681:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0f2c562b800 from lustre-OST0000 10000000:01000000:1.0:1787430682.013178:0:6681:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787430682.013181:0:6681:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787430682.013188:0:6681:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0f2c3458000 local copy 10000000:01000000:1.0:1787430682.013192:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787430682.013228:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.013239:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.013248:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430682.013265:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094336:0@lo:101: 00000100:00100000:1.0:1787430682.013301:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.013497:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.013604:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094336 00000100:00100000:0.0:1787430682.013612:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094336 00000100:00100000:0.0:1787430682.013656:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430682.013666:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:6681:x1874256856094336:12345-0@lo:101: 00010000:00010000:0.0:1787430682.013679:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430682.013693:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68b63 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.013715:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b63 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.013726:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b63 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.013736:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0030e00, rc 0) 00000100:00100000:0.0:1787430682.013831:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:6681:x1874256856094336:12345-0@lo:101: Request processed in 166us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.013837:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787430682.013928:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094336:0@lo:101: 00010000:00010000:2.0:1787430682.013941:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.013950:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.014061:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094464:0@lo:501: 00000100:00100000:2.0:1787430682.014092:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.014173:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c9e21e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.014215:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094464 00000100:00100000:0.0:1787430682.014220:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094464 00000100:00100000:0.0:1787430682.014286:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430682.014296:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:6681:x1874256856094464:12345-0@lo:501: 00000100:00100000:0.0:1787430682.014596:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:6681:x1874256856094464:12345-0@lo:501: Request processed in 301us (503us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430682.014604:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787430682.014756:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094464:0@lo:501: 10000000:01000000:2.0:1787430682.014768:0:6681:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787430682.014797:0:6681:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787430682.014804:0:6681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.014812:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.014819:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.014841:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787430682.014869:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0f2c562b800 10000000:01000000:2.0:1787430682.014875:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787430682.014879:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0f2c3458000 10000000:01000000:2.0:1787430682.014882:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787430682.014885:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0f2c3458000 from 1 10000000:01000000:2.0:1787430682.014889:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787430682.014910:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.014918:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.014928:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.014941:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094592:0@lo:101: 00000100:00100000:2.0:1787430682.014969:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430682.015049:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430682.015055:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.015062:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f302045200 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430682.015066:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.015075:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430682.015092:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430682.015097:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430682.015115:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.015121:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430682.015153:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.015161:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1fa5b1e070e68b6a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.015179:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430682.015181:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430682.015183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430682.015194:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856094720:0@lo:103: 00000100:00100000:1.0:1787430682.015224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.015290:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c9e21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.015482:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094592 00000100:00100000:0.0:1787430682.015487:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094592 00000100:00100000:0.0:1787430682.015516:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430682.015523:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:6681:x1874256856094592:12345-0@lo:101: 00010000:00010000:0.0:1787430682.015533:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430682.015545:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0030600/0x1fa5b1e070e68b78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68b71 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.015561:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0030600/0x1fa5b1e070e68b78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b71 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.015570:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0030600/0x1fa5b1e070e68b78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b71 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.015578:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0030600, rc 0) 00000100:00100000:0.0:1787430682.015621:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856094592:12345-0@lo:101: Request processed in 97us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.015627:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430682.015662:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094720 00000100:00100000:0.0:1787430682.015673:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094720 00000100:00100000:0.0:1787430682.015704:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430682.015710:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:3308:x1874256856094720:12345-0@lo:103: 00010000:00010000:0.0:1787430682.015719:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430682.015731:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68b63 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.015744:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430682.015773:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:3308:x1874256856094720:12345-0@lo:103: Request processed in 62us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.015778:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430682.015804:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856094720:0@lo:103: 00000100:00100000:2.0:1787430682.015899:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094592:0@lo:101: 00010000:00010000:2.0:1787430682.015912:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.015920:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430682.015933:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787430682.015982:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.015990:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430682.016005:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787430682.016009:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787430682.016014:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787430682.016016:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430682.016033:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.016040:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.016047:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.016060:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094848:0@lo:101: 00000100:00100000:2.0:1787430682.016086:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.016116:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c9e21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.016176:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094848 00000100:00100000:0.0:1787430682.016180:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094848 00000100:00100000:0.0:1787430682.016249:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430682.016255:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:6681:x1874256856094848:12345-0@lo:101: 00010000:00010000:0.0:1787430682.016263:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430682.016272:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68b7f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.016286:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.016294:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.016301:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0031000, rc 0) 00000100:00100000:0.0:1787430682.016366:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856094848:12345-0@lo:101: Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.016380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430682.016523:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094848:0@lo:101: 00010000:00010000:2.0:1787430682.016533:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.016540:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.016616:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094976:0@lo:501: 00000100:00100000:2.0:1787430682.016643:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.016661:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c9e21d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.016674:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856094976 00000100:00100000:2.0:1787430682.016684:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856094976 00000100:00100000:2.0:1787430682.016706:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787430682.016713:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856094976:12345-0@lo:501: 00000100:00100000:2.0:1787430682.016922:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856094976:12345-0@lo:501: Request processed in 209us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.016929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787430682.016960:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856094976:0@lo:501: 00000100:00100000:2.0:1787430682.016985:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095104:0@lo:503: 00000100:00100000:2.0:1787430682.017023:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.017037:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c9e21d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.017049:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095104 00000100:00100000:2.0:1787430682.017053:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095104 00000100:00100000:2.0:1787430682.017069:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430682.017074:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095104:12345-0@lo:503: 00000100:00100000:2.0:1787430682.017216:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095104:12345-0@lo:503: Request processed in 140us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.017223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430682.017265:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095104:0@lo:503: 00000040:00080000:2.0:1787430682.017774:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430682.017833:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095232:0@lo:502: 00000100:00100000:2.0:1787430682.017874:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.017947:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d8bcbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.017994:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095232 00000100:00100000:0.0:1787430682.017999:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095232 00000100:00100000:0.0:1787430682.018070:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787430682.018080:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095232:12345-0@lo:502: 00000100:00100000:0.0:1787430682.018249:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095232:12345-0@lo:502: Request processed in 171us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.018256:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787430682.018382:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095232:0@lo:502: 00000040:00080000:3.0:1787430682.018626:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787430682.018682:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787430682.018720:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787430682.018786:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787430682.018828:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787430682.018861:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787430682.018888:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095360:0@lo:502: 00000100:00100000:3.0:1787430682.018925:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430682.018960:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c784b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.019084:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095360 00000100:00100000:2.0:1787430682.019091:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095360 00000100:00100000:2.0:1787430682.019137:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430682.019144:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095360:12345-0@lo:502: 00000100:00100000:2.0:1787430682.019293:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095360:12345-0@lo:502: Request processed in 149us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.019300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430682.019505:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095360:0@lo:502: 00000040:00080000:3.0:1787430682.019592:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787430682.019601:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787430682.020248:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787430682.020255:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787430682.020262:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430682.020265:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787430682.020270:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430682.020285:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0f2fe368000) 00000020:00000080:3.0:1787430682.020309:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787430682.020316:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787430682.020404:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f2c562b800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787430682.020412:0:6699:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430682.020419:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1fa5b1e070e68b94 00010000:00010000:3.0:1787430682.026518:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787430682.026824:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787430682.029278:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787430682.029603:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787430682.035871:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787430682.036995:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787430682.038241:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787430682.038253:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430682.038260:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430682.038262:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787430682.038266:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430682.038270:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430682.038271:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787430682.038274:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430682.038276:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787430682.039440:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430682.039447:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430682.039455:0:6699:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787430682.039460:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787430682.041281:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787430682.041360:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787430682.041381:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.041394:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430682.041403:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2c562b800 from 1 10000000:01000000:2.0:1787430682.041406:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430682.041443:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.041451:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.041462:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.041487:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095488:0@lo:101: 00000100:00100000:2.0:1787430682.041557:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.041611:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d8bcbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.041940:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095488 00000100:00100000:0.0:1787430682.041947:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095488 00000100:00100000:0.0:1787430682.041988:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787430682.041999:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:6681:x1874256856095488:12345-0@lo:101: 00010000:00010000:0.0:1787430682.042011:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430682.042023:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68b9b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.042045:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.042055:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.042064:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0030e00, rc 0) 00000100:00100000:0.0:1787430682.042108:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095488:12345-0@lo:101: Request processed in 111us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.042114:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787430682.042179:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095488:0@lo:101: 00010000:00010000:0.0:1787430682.042201:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430682.042209:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430682.042449:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095616:0@lo:501: 00000100:00100000:0.0:1787430682.042479:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430682.042496:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.042569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095616 00000100:00100000:2.0:1787430682.042577:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095616 00000100:00100000:2.0:1787430682.042606:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787430682.042613:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095616:12345-0@lo:501: 00000100:00100000:2.0:1787430682.042830:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095616:12345-0@lo:501: Request processed in 216us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.042837:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787430682.042915:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095616:0@lo:501: 00000100:00100000:0.0:1787430682.042943:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095744:0@lo:503: 00000100:00100000:0.0:1787430682.042977:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430682.042998:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.043054:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095744 00000100:00100000:2.0:1787430682.043058:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095744 00000100:00100000:2.0:1787430682.043084:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430682.043092:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095744:12345-0@lo:503: 00000100:00100000:2.0:1787430682.043499:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095744:12345-0@lo:503: Request processed in 407us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.043506:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787430682.043595:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095744:0@lo:503: 00000040:00080000:0.0:1787430682.043845:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430682.043915:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095872:0@lo:502: 00000100:00100000:0.0:1787430682.043951:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430682.043980:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.046423:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856095872 00000100:00100000:2.0:1787430682.046437:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856095872 00000100:00100000:2.0:1787430682.046494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430682.046504:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095872:12345-0@lo:502: 00000100:00100000:2.0:1787430682.046795:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856095872:12345-0@lo:502: Request processed in 292us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.046803:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787430682.046952:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856095872:0@lo:502: 00000040:00080000:0.0:1787430682.047265:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787430682.047415:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787430682.047453:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096000:0@lo:502: 00000100:00100000:0.0:1787430682.047497:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430682.047533:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.048014:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096000 00000100:00100000:2.0:1787430682.048021:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096000 00000100:00100000:2.0:1787430682.048060:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787430682.048069:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856096000:12345-0@lo:502: 00000100:00100000:2.0:1787430682.049543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856096000:12345-0@lo:502: Request processed in 1471us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.049553:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430682.050685:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096000:0@lo:502: 00000040:00080000:3.0:1787430682.050863:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787430682.050880:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787430682.054249:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430682.054262:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430682.054270:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787430682.054277:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2c562b800 00000020:00000080:0.0:1787430682.054280:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787430682.054530:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430682.054535:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430682.054537:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787430682.054540:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787430682.054691:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787430682.054727:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430682.054789:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.054802:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430682.054842:0:6681:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787430682.054846:0:6681:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0f2c562b800 10000000:01000000:1.0:1787430682.054849:0:6681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0f2c562b800 10000000:01000000:1.0:1787430682.054853:0:6681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787430682.054859:0:6681:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2c562b800 from 1 10000000:01000000:1.0:1787430682.054861:0:6681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430682.054899:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.054907:0:6681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.054918:0:6681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430682.054939:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096128:0@lo:101: 00000100:00100000:1.0:1787430682.055008:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.055102:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430682.055171:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096128 00000100:00100000:3.0:1787430682.055179:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096128 00000100:00100000:3.0:1787430682.055260:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787430682.055270:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856096128:12345-0@lo:101: 00010000:00010000:3.0:1787430682.055284:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430682.055299:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68ba9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430682.055373:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430682.055383:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430682.055393:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147be00, rc 0) 00000100:00100000:3.0:1787430682.055437:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096128:12345-0@lo:101: Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430682.055443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430682.055524:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096128:0@lo:101: 00010000:00010000:1.0:1787430682.055538:0:6681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.055554:0:6681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430682.055640:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096256:0@lo:501: 00000100:00100000:1.0:1787430682.055665:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.055935:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.055990:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096256 00000100:00100000:0.0:1787430682.055995:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096256 00000100:00100000:0.0:1787430682.056017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787430682.056024:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096256:12345-0@lo:501: 00000100:00100000:0.0:1787430682.056300:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096256:12345-0@lo:501: Request processed in 275us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.056319:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787430682.056544:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096256:0@lo:501: 00000100:00100000:1.0:1787430682.056576:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096384:0@lo:503: 00000100:00100000:1.0:1787430682.056617:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.056643:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430682.056705:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096384 00000100:00100000:3.0:1787430682.056710:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096384 00000100:00100000:3.0:1787430682.056731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787430682.056737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096384:12345-0@lo:503: 00000100:00100000:3.0:1787430682.056887:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096384:12345-0@lo:503: Request processed in 149us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430682.056894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430682.056972:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096384:0@lo:503: 00000040:00080000:1.0:1787430682.057253:0:6681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430682.057438:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096512:0@lo:502: 00000100:00100000:1.0:1787430682.057476:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.057594:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430682.057648:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096512 00000100:00100000:2.0:1787430682.057653:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096512 00000100:00100000:3.0:1787430682.057694:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430682.057703:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096512:12345-0@lo:502: 00000100:00100000:3.0:1787430682.057869:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096512:12345-0@lo:502: Request processed in 167us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430682.057875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787430682.057950:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096512:0@lo:502: 00000040:00080000:1.0:1787430682.058223:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787430682.058272:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787430682.058322:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787430682.058568:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787430682.058609:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787430682.058670:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787430682.058710:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787430682.058746:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787430682.058793:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787430682.058830:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787430682.058877:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787430682.058924:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787430682.058961:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787430682.058995:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787430682.059044:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787430682.059079:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787430682.059110:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787430682.059170:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787430682.059205:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787430682.059257:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787430682.059306:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787430682.059368:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787430682.059405:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787430682.059459:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787430682.059490:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787430682.059516:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787430682.059552:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787430682.059579:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787430682.059619:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096640:0@lo:502: 00000100:00100000:1.0:1787430682.059676:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.059703:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430682.059966:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096640 00000100:00100000:3.0:1787430682.059972:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096640 00000100:00100000:3.0:1787430682.060004:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787430682.060011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096640:12345-0@lo:502: 00000100:00100000:3.0:1787430682.060199:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856096640:12345-0@lo:502: Request processed in 188us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430682.060206:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430682.060283:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feede300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856096640:0@lo:502: 00000040:00080000:1.0:1787430682.060469:0:6681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787430682.060479:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787430682.061054:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787430682.061067:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0f2ed32b370) 00000020:00000080:0.0:1787430682.061086:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787430682.061153:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f2c562b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787430682.061157:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f2c562b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787430682.061160:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2c562b800 3 00010000:00080000:0.0:1787430682.061185:0:6704:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f1c509c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787430682.063590:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787430682.063853:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787430682.063891:0:6704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787430682.063904:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1fa5b1e070e68bbe 00000100:00080000:0.0:1787430682.063914:0:6704:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430682.063918:0:6704:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0f1c509c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787430682.063954:0:6704:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2f73cce00 x1874256856096768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787430682.063984:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787430682.064147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1874256856096768:0@lo:38: 00000100:00100000:1.0:1787430682.064211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.064445:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856096896:0@lo:400: 00000100:00100000:1.0:1787430682.064473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430682.064564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096768 00000100:00100000:0.0:1787430682.064572:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096768 00000100:00100000:0.0:1787430682.064601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856096896 00000100:00100000:0.0:1787430682.064604:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856096896 00000100:00100000:0.0:1787430682.064627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430682.064635:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856096896:12345-0@lo:400: 00000100:00100000:0.0:1787430682.064693:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856096896:12345-0@lo:400: Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.064700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430682.064715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430682.064719:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874256856096768:12345-0@lo:38: 00010000:00080000:0.0:1787430682.064742:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1787430682.064772:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1fa5b1e070e68bc5 00000004:00100000:0.0:1787430682.064785:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787430682.064812:0:5839:0:(import.c:65:import_set_state_nolock()) ffffa0f2ed341000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430682.064848:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874256856096768:12345-0@lo:38: Request processed in 127us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430682.064855:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787430682.064887:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0f2c9395500 x1874256856096896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430682.064900:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856096896:0@lo:400: 00010000:00080000:0.0:1787430682.064930:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0f2f73cce00 x1874256856096768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430682.064939:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430682.064945:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787430682.064951:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787430682.064963:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787430682.064965:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f1c509c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430682.064970:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1874256856096768:0@lo:38: 00000040:00080000:0.0:1787430682.065096:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787430682.065297:0:6681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787430682.065361:0:6681:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430682.065384:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.065395:0:6681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787430682.065437:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787430682.065440:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787430682.065441:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430682.065442:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430682.065444:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430682.065445:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430682.065446:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430682.065448:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430682.065450:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430682.065451:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430682.065453:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430682.065458:0:6681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787430682.065460:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430682.065462:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787430682.065463:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430682.065464:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430682.065465:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430682.065467:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430682.065468:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430682.065469:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430682.065470:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430682.065471:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430682.065472:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430682.065488:0:6681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787430682.065500:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856097024:0@lo:253: 00000100:00100000:1.0:1787430682.065558:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.065581:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430682.065726:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097024 00000100:00100000:0.0:1787430682.065731:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097024 00000100:00100000:0.0:1787430682.065859:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430682.065868:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6681:x1874256856097024:12345-0@lo:253: 20000000:01000000:0.0:1787430682.065888:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787430682.065901:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787430682.092385:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787430682.092405:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787430682.092614:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787430682.092631:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787430682.092652:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.092672:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.092681:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.092724:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.092738:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 13 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.092753:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874256856097152:0@lo:104: 00000100:00100000:2.0:1787430682.092821:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430682.092875:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4a6acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430682.092961:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097152 00000100:00100000:1.0:1787430682.092969:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097152 00000100:00100000:1.0:1787430682.093020:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430682.093041:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5853:x1874256856097152:12345-0@lo:104: 00010000:00010000:1.0:1787430682.093054:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093114:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430682.093119:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5853:x1874256856097152:12345-0@lo:104: Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430682.093137:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787430682.093157:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430682.093163:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093170:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430682.093173:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093181:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430682.093188:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430682.093194:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430682.093224:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093230:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430682.093245:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093261:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093277:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430682.093279:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430682.093281:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430682.093293:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856097280:0@lo:103: 00000100:00100000:1.0:1787430682.093356:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430682.093394:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097280 00000100:00100000:1.0:1787430682.093398:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097280 00010000:00010000:1.0:1787430682.093419:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 14 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430682.093443:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430682.093450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3310:x1874256856097280:12345-0@lo:103: 00010000:00010000:1.0:1787430682.093461:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430682.093466:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 14 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093476:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 14 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093491:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093499:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787430682.093511:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001447111s 00010000:00010000:1.0:1787430682.093521:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093528:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093534:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093540:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093545:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430682.093549:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093556:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093564:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430682.093573:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430682.093608:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3310:x1874256856097280:12345-0@lo:103: Request processed in 158us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430682.093616:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430682.093646:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856097280:0@lo:103: 00010000:00010000:2.0:1787430682.093724:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68b2b expref: 13 pid: 5831 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.093734:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874256856097152:0@lo:104: 00010000:00010000:2.0:1787430682.093746:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.093755:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.093761:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430682.093777:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68bcc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430682.101869:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:6681:x1874256856097024:12345-0@lo:253: Request processed in 35992us (36301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430682.101885:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787430682.101967:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6681:1874256856097024:0@lo:253: 10000000:01000000:1.0:1787430682.101983:0:6681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787430682.101987:0:6681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430682.101989:0:6681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787430682.101990:0:6681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430682.102006:0:6681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430682.102007:0:6681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430682.102009:0:6681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430682.102010:0:6681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430682.102012:0:6681:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430682.102014:0:6681:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430682.102015:0:6681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430682.102017:0:6681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787430682.102035:0:6681:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787430682.107519:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430682.107639:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787430682.107774:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430682.107870:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787430682.108205:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787430682.108564:0:6681:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787430682.110046:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787430682.264260:0:6681:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787430682.264270:0:6681:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787430682.265952:0:6681:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787430682.266179:0:6681:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787430682.266200:0:6681:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787430682.266234:0:6681:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787430682.652547:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430683.678082:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430684.701223:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787430684.764751:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787430684.764759:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2d0492800 from 21 10000000:01000000:0.0:1787430684.764765:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430684.764823:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430684.764836:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430684.764857:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430684.764890:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856097408:0@lo:101: 00000100:00100000:0.0:1787430684.764963:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430684.765003:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c51f80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.765662:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097408 00000100:00100000:3.0:1787430684.765674:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097408 00000100:00100000:3.0:1787430684.765725:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430684.765736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856097408:12345-0@lo:101: 00010000:00010000:3.0:1787430684.765754:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430684.765768:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.765800:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.765811:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.765821:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430684.765885:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856097408:12345-0@lo:101: Request processed in 150us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.765892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430684.765948:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856097408:0@lo:101: 00010000:00010000:3.0:1787430684.765963:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.765973:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430684.766043:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856097536:0@lo:501: 00000100:00100000:3.0:1787430684.766082:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430684.766109:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2b73600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.766133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097536 00000100:00100000:3.0:1787430684.766137:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097536 00000100:00100000:3.0:1787430684.766158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430684.766165:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856097536:12345-0@lo:501: 00000100:00100000:3.0:1787430684.766758:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856097536:12345-0@lo:501: Request processed in 592us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.766766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430684.766795:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856097536:0@lo:501: 00000100:00100000:3.0:1787430684.766829:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856097664:0@lo:503: 00000100:00100000:3.0:1787430684.766865:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430684.766879:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2b73600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.766891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097664 00000100:00100000:3.0:1787430684.766894:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097664 00000100:00100000:3.0:1787430684.766910:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430684.766915:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856097664:12345-0@lo:503: 00000100:00100000:3.0:1787430684.767185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856097664:12345-0@lo:503: Request processed in 269us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.767192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430684.767226:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856097664:0@lo:503: 00000100:00100000:3.0:1787430684.767666:0:6877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6877:1874256856097792:0@lo:502: 00000100:00100000:3.0:1787430684.767698:0:6877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430684.767725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097792 00000100:00100000:3.0:1787430684.767729:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097792 00000100:00100000:3.0:1787430684.767751:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430684.767757:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6877:x1874256856097792:12345-0@lo:502: 00000100:00100000:3.0:1787430684.767957:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6877:x1874256856097792:12345-0@lo:502: Request processed in 200us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.767964:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430684.768002:0:6877:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2b73000 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.768013:0:6877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6877:1874256856097792:0@lo:502: 00000100:00100000:3.0:1787430684.768050:0:6877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6877:1874256856097920:0@lo:502: 00000100:00100000:3.0:1787430684.768091:0:6877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430684.768116:0:6877:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2b73000 going to sleep for 11 seconds 00000100:00100000:2.0:1787430684.768188:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856097920 00000100:00100000:2.0:1787430684.768193:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856097920 00000100:00100000:2.0:1787430684.768226:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787430684.768233:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6877:x1874256856097920:12345-0@lo:502: 00000100:00100000:2.0:1787430684.768586:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:6877:x1874256856097920:12345-0@lo:502: Request processed in 351us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430684.768587:0:6877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6877:1874256856097920:0@lo:502: 00000100:00100000:2.0:1787430684.768601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000040:00080000:1.0:1787430684.768616:0:6877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787430684.768712:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787430684.768734:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787430684.768743:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.768754:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430684.768764:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430684.768766:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f2d0492800 from 4 10000000:01000000:3.0:1787430684.768769:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430684.768793:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.768801:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.768819:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430684.768832:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098048:0@lo:101: 00000100:00100000:3.0:1787430684.768858:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430684.769007:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2b739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430684.769149:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098048 00000100:00100000:1.0:1787430684.769154:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098048 00000100:00100000:1.0:1787430684.769222:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787430684.769230:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856098048:12345-0@lo:101: 00010000:00010000:1.0:1787430684.769239:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430684.769253:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68be1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430684.769274:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430684.769283:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430684.769292:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302044a00, rc 0) 00000100:00100000:1.0:1787430684.769358:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856098048:12345-0@lo:101: Request processed in 129us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430684.769369:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787430684.769726:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098048:0@lo:101: 00010000:00010000:2.0:1787430684.769740:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430684.769749:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430684.769794:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098176:0@lo:256: 00000100:00100000:2.0:1787430684.769828:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430684.769928:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.769996:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098176 00000100:00100000:3.0:1787430684.770001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098176 00000100:00100000:3.0:1787430684.770023:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787430684.770029:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856098176:12345-0@lo:256: 20000000:01000000:3.0:1787430684.770047:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787430684.770066:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787430684.770080:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787430684.770249:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856098176:12345-0@lo:256: Request processed in 219us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.770257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430684.770314:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098176:0@lo:256: 10000000:01000000:2.0:1787430684.770561:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787430684.770568:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430684.770583:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430684.770592:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787430684.770594:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787430684.770597:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787430684.770619:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430684.770626:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430684.770635:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430684.770650:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098304:0@lo:101: 00000100:00100000:2.0:1787430684.770676:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430684.770745:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.770776:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098304 00000100:00100000:3.0:1787430684.770781:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098304 00000100:00100000:3.0:1787430684.770799:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787430684.770805:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856098304:12345-0@lo:101: 00010000:00010000:3.0:1787430684.770814:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430684.770825:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68bef expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.770842:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.770851:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.770864:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a200, rc 0) 00000100:00100000:3.0:1787430684.770928:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856098304:12345-0@lo:101: Request processed in 123us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.770934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787430684.770988:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098304:0@lo:101: 00010000:00010000:2.0:1787430684.770998:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430684.771005:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430684.771047:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098432:0@lo:501: 00000100:00100000:2.0:1787430684.771079:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430684.771141:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.771169:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098432 00000100:00100000:3.0:1787430684.771172:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098432 00000100:00100000:3.0:1787430684.771189:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430684.771195:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856098432:12345-0@lo:501: 00000100:00100000:3.0:1787430684.771886:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856098432:12345-0@lo:501: Request processed in 687us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.771894:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787430684.771949:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098432:0@lo:501: 00000100:00100000:0.0:1787430684.771984:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098560:0@lo:503: 00000100:00100000:0.0:1787430684.772026:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430684.772058:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c51f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430684.772132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098560 00000100:00100000:2.0:1787430684.772136:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098560 00000100:00100000:2.0:1787430684.772194:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787430684.772202:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856098560:12345-0@lo:503: 00000100:00100000:2.0:1787430684.772695:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856098560:12345-0@lo:503: Request processed in 494us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430684.772703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787430684.772761:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856098560:0@lo:503: 00000100:00100000:2.0:1787430684.773011:0:6878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6878:1874256856098688:0@lo:502: 00000100:00100000:2.0:1787430684.773043:0:6878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430684.773112:0:6878:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090780 going to sleep for 11 seconds 00000100:00100000:0.0:1787430684.773140:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098688 00000100:00100000:0.0:1787430684.773144:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098688 00000100:00100000:0.0:1787430684.773175:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787430684.773182:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:6878:x1874256856098688:12345-0@lo:502: 00000100:00100000:0.0:1787430684.773538:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:6878:x1874256856098688:12345-0@lo:502: Request processed in 356us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430684.773545:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787430684.773599:0:6878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6878:1874256856098688:0@lo:502: 00000020:01000000:2.0:1787430684.773622:0:6878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787430684.773630:0:6878:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787430684.773636:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430684.773638:0:6878:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787430684.773643:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430684.773647:0:6878:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:2.0:1787430684.773667:0:6878:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787430684.773669:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430684.773691:0:6878:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0f2c3ec99b8) 00000020:00000080:2.0:1787430684.773712:0:6878:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787430684.773717:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430684.773802:0:6878:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787430684.773807:0:6878:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787430684.773814:0:6878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68c04 00010000:00080000:2.0:1787430684.773841:0:6878:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2fefae800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787430684.774044:0:6878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787430684.814041:0:6878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787430684.814064:0:6878:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787430684.814632:0:6878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787430684.814802:0:6878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787430684.814847:0:6878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787430684.814903:0:6878:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787430684.815776:0:6882:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430684.815782:0:6882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787430684.816929:0:6878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430684.816945:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787430684.816982:0:6878:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787430684.817003:0:6878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e68c0b 00000100:00080000:2.0:1787430684.817014:0:6878:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430684.817020:0:6878:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0f2fefae800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787430684.817053:0:6878:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2c9397100 x1874256856098816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430684.817130:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856098816:0@lo:8: 00000100:00100000:1.0:1787430684.817202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787430684.817290:0:6878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787430684.817368:0:6878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430684.817372:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430684.817374:0:6878:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787430684.817378:0:6878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430684.817382:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430684.817383:0:6878:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787430684.817386:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787430684.817388:0:6878:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787430684.817413:0:6878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6878:1874256856098944:0@lo:502: 00000100:00100000:2.0:1787430684.817454:0:6878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430684.817475:0:6878:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c10903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430684.817495:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098944 00000100:00100000:2.0:1787430684.817501:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098944 00000100:00100000:2.0:1787430684.817536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787430684.817545:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:6878:x1874256856098944:12345-0@lo:502: 00000100:00100000:2.0:1787430684.817753:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:6878:x1874256856098944:12345-0@lo:502: Request processed in 207us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430684.817761:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787430684.817809:0:6878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:6878:1874256856098944:0@lo:502: 00000020:01000000:2.0:1787430684.817831:0:6878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430684.817838:0:6878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430684.817840:0:6878:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787430684.817844:0:6878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1787430684.817949:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856098816 00000100:00100000:3.0:1787430684.817954:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856098816 00000100:00100000:3.0:1787430684.817980:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430684.817986:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1874256856098816:12345-0@lo:8: 00010000:00080000:3.0:1787430684.818006:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:3.0:1787430684.818031:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e68c12 00002000:00100000:3.0:1787430684.818062:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0f1c4dea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787430684.818066:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787430684.818085:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787430684.818203:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787430684.818355:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787430684.818376:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f1c4dea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430684.818841:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874256856098816:12345-0@lo:8: Request processed in 852us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.818849:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787430684.818907:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2c9397100 x1874256856098816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430684.818917:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430684.818925:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787430684.818932:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787430684.818936:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787430684.818938:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2fefae800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787430684.819014:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787430684.819020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856098816:0@lo:8: 00000004:00080000:2.0:1787430684.819096:0:6882:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787430684.819191:0:6882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 148373863166ns, next at 0ns, rc = 0 00000020:01000000:0.0:1787430684.820511:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787430684.820545:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787430684.820558:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430684.820571:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430684.820627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856099072:0@lo:400: 00000100:00100000:0.0:1787430684.820827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430684.820871:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430684.820877:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856099200:0@lo:400: 00000100:00100000:0.0:1787430684.820899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430684.820943:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099072 00000100:00100000:0.0:1787430684.820950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099072 00000100:00100000:2.0:1787430684.820963:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099200 00000100:00100000:2.0:1787430684.820967:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099200 00000100:00100000:0.0:1787430684.820996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430684.821004:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856099072:12345-0@lo:400: 00000100:00080000:1.0:1787430684.821023:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430684.821060:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856099072:12345-0@lo:400: Request processed in 57us (234us total) trans 0 rc 0/0 00010000:00080000:1.0:1787430684.821287:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2feeddf80 x1874256856099072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430684.821302:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856099072:0@lo:400: 10000000:01000000:1.0:1787430684.821948:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787430684.821952:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0f2c3458000 from 1 10000000:01000000:1.0:1787430684.821955:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787430684.821989:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430684.821998:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430684.822023:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430684.822040:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856099328:0@lo:101: 00000100:00100000:1.0:1787430684.822096:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430684.822123:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93ae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430684.822618:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787430684.822627:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787430684.823471:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099328 00000100:00100000:3.0:1787430684.823481:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099328 00000100:00100000:3.0:1787430684.823955:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430684.823966:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856099328:12345-0@lo:101: 00010000:00010000:3.0:1787430684.823980:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430684.823996:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68c19 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.824020:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.824031:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.824040:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a800, rc 0) 00000100:00100000:3.0:1787430684.824115:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856099328:12345-0@lo:101: Request processed in 150us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.824122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430684.824156:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787430684.824166:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430684.824173:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856099200:12345-0@lo:400: 00000100:00100000:3.0:1787430684.824209:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856099200:12345-0@lo:400: Request processed in 38us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430684.824224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430684.824262:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856099328:0@lo:101: 00010000:00010000:3.0:1787430684.824276:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.824285:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430684.824363:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856099456:0@lo:501: 00000100:00100000:3.0:1787430684.824392:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430684.824419:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c57259c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787430684.824448:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2feedc700 x1874256856099200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430684.824459:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856099200:0@lo:400: 00000100:00100000:3.0:1787430684.824480:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099456 00000100:00100000:3.0:1787430684.824484:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099456 00000100:00100000:3.0:1787430684.824505:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787430684.824511:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856099456:12345-0@lo:501: 00000100:00100000:3.0:1787430684.824713:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856099456:12345-0@lo:501: Request processed in 200us (318us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430684.824720:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787430684.824752:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856099456:0@lo:501: 10000000:01000000:3.0:1787430684.824774:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787430684.824780:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430684.824798:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430684.828164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1787430684.857653:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787430684.876981:0:6883:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787430684.877007:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856099712:0@lo:7: 00000100:00100000:1.0:1787430684.877062:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430684.877130:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430684.877167:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856099584:0@lo:13: 00000100:00100000:0.0:1787430684.877209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430684.877298:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099712 00000100:00100000:0.0:1787430684.877306:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099712 00000100:00080000:1.0:1787430684.877352:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430684.877408:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430684.877418:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6883:x1874256856099712:12345-0@lo:7: 00000100:00100000:2.0:1787430684.877571:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099584 00000100:00100000:2.0:1787430684.877576:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099584 00000100:00100000:2.0:1787430684.877642:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430684.877649:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856099584:12345-0@lo:13: 00002000:00000024:2.0:1787430684.877670:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787430684.877716:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856099584:12345-0@lo:13: Request processed in 68us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430684.877723:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787430684.878434:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2feeddc00 x1874256856099584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430684.878457:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856099584:0@lo:13: 00002000:00080000:0.0:1787430684.882505:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787430684.882516:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787430684.882711:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6883:x1874256856099712:12345-0@lo:7: Request processed in 5290us (5642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430684.882724:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787430684.882826:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2feedf100 x1874256856099712/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430684.882842:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856099712:0@lo:7: 00000004:00080000:1.0:1787430684.882858:0:6883:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787430684.882901:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856099840:0@lo:5: 00000100:00100000:1.0:1787430684.882939:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430684.883034:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430684.883122:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099840 00000100:00100000:3.0:1787430684.883130:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099840 00000100:00100000:3.0:1787430684.883254:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430684.883264:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6883:x1874256856099840:12345-0@lo:5: 00002000:00080000:3.0:1787430684.883292:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787430684.883296:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787430684.883584:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feeddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6883:x1874256856099840:12345-0@lo:5: Request processed in 321us (643us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787430684.883590:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787430684.883656:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2feedf100 x1874256856099840/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430684.883669:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856099840:0@lo:5: 00000004:00080000:0.0:1787430684.883686:0:6883:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787430684.883714:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856099968:0@lo:700: 00000100:00100000:0.0:1787430684.883796:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430684.883828:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c51f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430684.884041:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856099968 00000100:00100000:2.0:1787430684.884045:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856099968 00000100:00100000:2.0:1787430684.884092:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430684.884100:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6883:x1874256856099968:12345-0@lo:700: 00000100:00100000:2.0:1787430684.884131:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6692:1874256856100096:0@lo:700: 00000100:00100000:2.0:1787430684.884164:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430684.884230:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430684.884307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100096 00000100:00100000:1.0:1787430684.884312:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100096 00000100:00100000:1.0:1787430684.884589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430684.884598:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6692:x1874256856100096:12345-0@lo:700: 40000000:02000000:2.0:1787430684.909939:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787430684.919486:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6692:x1874256856100096:12345-0@lo:700: Request processed in 34881us (35312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430684.919505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787430684.919626:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2c9397b80 x1874256856100096/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787430700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430684.919642:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6692:1874256856100096:0@lo:700: 40000000:02000000:3.0:1787430684.919655:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787430684.984446:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787430684.984463:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787430684.984687:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6883:x1874256856099968:12345-0@lo:700: Request processed in 100583us (100885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430684.984713:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787430684.984919:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2f73cc380 x1874256856099968/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787430700 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430684.984931:0:6883:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787430684.984950:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856099968:0@lo:700: 00000004:02000040:0.0:1787430685.011594:0:6883:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787430685.020401:0:6883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856100224:0@lo:5: 00000100:00100000:0.0:1787430685.020481:0:6883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430685.020541:0:6883:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c51f8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430685.020569:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100224 00000100:00100000:1.0:1787430685.020578:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100224 00000100:00100000:1.0:1787430685.020636:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430685.020648:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6883:x1874256856100224:12345-0@lo:5: 00002000:00080000:0.0:1787430685.027280:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787430685.027303:0:6686:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787430685.031626:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6883:x1874256856100224:12345-0@lo:5: Request processed in 10973us (11139us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787430685.031640:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787430685.031739:0:6883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2f73cc380 x1874256856100224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430701 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430685.031757:0:6883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6883:1874256856100224:0@lo:5: 00000004:00080000:3.0:1787430685.031771:0:6883:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787430685.724501:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430686.400672:0:7052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787430686.748491:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430687.772468:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430688.796476:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430689.823385:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430690.013553:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856100352:0@lo:13: 00000100:00100000:0.0:1787430690.013661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430690.013798:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100352 00000100:00100000:0.0:1787430690.013809:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100352 00000100:00100000:0.0:1787430690.013882:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430690.013893:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856100352:12345-0@lo:13: 00002000:00000024:0.0:1787430690.013955:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430690.014022:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856100352:12345-0@lo:13: Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430690.014031:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787430690.014070:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430690.014375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856100480:0@lo:400: 00000100:00100000:2.0:1787430690.014439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430690.014483:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430690.014498:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856100608:0@lo:400: 00000100:00100000:2.0:1787430690.014535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430690.014575:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100480 00000100:00100000:2.0:1787430690.014649:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100480 00000100:00100000:2.0:1787430690.014714:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787430690.014723:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3307:x1874256856100480:12345-0@lo:400: 00000100:00100000:2.0:1787430690.015837:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100608 00000100:00100000:2.0:1787430690.015848:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100608 00000100:00100000:2.0:1787430690.015914:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787430690.015925:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856100608:12345-0@lo:400: 00000100:00100000:2.0:1787430690.016137:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856100608:12345-0@lo:400: Request processed in 213us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430690.016147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430690.016200:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3307:x1874256856100480:12345-0@lo:400: Request processed in 1476us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430690.016210:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1787430690.016230:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2c9396300 x1874256856100608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430690.016250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856100608:0@lo:400: 00000100:00100000:2.0:1787430690.016267:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856100480:0@lo:400: 00000100:00100000:0.0:1787430690.016981:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856100736:0@lo:400: 00000100:00100000:0.0:1787430690.017083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430690.017122:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100736 00000100:00100000:3.0:1787430690.017132:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100736 00000100:00100000:3.0:1787430690.021745:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430690.021782:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856100736:12345-0@lo:400: 00000100:00080000:0.0:1787430690.021842:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787430690.021911:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2f73cd180 x1874256856100352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430690.021939:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856100352:0@lo:13: 00000100:00100000:3.0:1787430690.022067:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856100736:12345-0@lo:400: Request processed in 299us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430690.022079:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787430690.022205:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2c9397b80 x1874256856100736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430690.022222:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856100736:0@lo:400: 00000001:00080000:2.0:1787430690.080046:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787430690.844725:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430691.868445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430692.892455:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430693.916579:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787430694.221423:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787430694.221426:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787430694.221540:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0f1c4de8800 00000020:01000004:2.0:1787430694.221554:0:7630:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787430694.221566:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787430694.221579:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0f2c3eccd28) 00000020:00000080:2.0:1787430694.221597:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787430694.240558:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787430694.240814:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787430694.257289:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787430694.261601:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787430694.261635:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787430694.261693:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787430694.261722:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787430694.262091:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787430694.262104:0:7630:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787430694.262114:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1fa5b1e070e68c2e 00000020:01000004:3.0:1787430694.262122:0:7630:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787430694.262142:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787430694.262145:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787430694.262150:0:7630:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787430694.262172:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787430694.262176:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787430694.279648:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787430694.279692:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.160@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787430694.279696:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787430694.279698:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430694.279699:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430694.279700:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430694.279701:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430694.279702:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430694.279704:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430694.279706:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430694.279708:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430694.279709:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430694.279711:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430694.279714:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787430694.279716:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787430694.279717:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430694.279719:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430694.279720:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430694.279721:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430694.279722:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430694.279723:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430694.279724:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787430694.279725:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787430694.279726:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430694.279727:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430694.279764:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787430694.279782:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856100864:0@lo:253: 00000100:00100000:3.0:1787430694.279849:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430694.279964:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93ae3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430694.280010:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100864 00000100:00100000:0.0:1787430694.280018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100864 00000100:00100000:0.0:1787430694.280100:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787430694.280112:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:7630:x1874256856100864:12345-0@lo:253: 20000000:01000000:0.0:1787430694.280142:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787430694.280146:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787430694.280152:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787430694.280156:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787430694.281066:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430694.281285:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787430694.281301:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787430694.281366:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787430694.281376:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787430694.281407:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787430694.281455:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787430694.281851:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787430694.281873:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.160@tcp 20000000:01000000:0.0:1787430694.281880:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.160@tcp (null) (null) (null) 00000040:00080000:0.0:1787430694.281935:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787430694.281945:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787430694.281995:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787430694.282005:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.160@tcp (null) (null) 00000040:00080000:0.0:1787430694.282036:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787430694.282046:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787430694.282072:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787430694.282120:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787430694.282836:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787430694.282855:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.160@tcp 20000000:01000000:0.0:1787430694.283242:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.160@tcp (null) (null) (null) 00000040:00080000:1.0:1787430694.283514:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787430694.283525:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787430694.283559:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787430694.283567:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.160@tcp (null) (null) 00000040:00080000:1.0:1787430694.283598:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787430694.283607:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787430694.283661:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787430694.283700:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787430694.283723:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787430694.283726:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787430694.283733:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787430694.283734:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787430694.283736:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787430694.283748:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787430694.283750:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787430694.283786:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787430694.283789:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787430694.284191:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787430694.284484:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787430694.284525:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787430694.284584:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787430694.284599:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787430694.284602:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787430694.285048:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787430694.285099:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787430694.285157:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787430694.285411:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787430694.285465:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787430694.285515:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787430694.285529:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787430694.285536:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787430694.285990:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787430694.286039:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787430694.286109:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787430694.286395:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787430694.286436:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787430694.286469:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787430694.286480:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787430694.286483:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787430694.287266:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787430694.287478:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787430694.287513:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787430694.287771:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787430694.287809:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787430694.287854:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1787430694.287873:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787430694.287906:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287924:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287932:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287939:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287946:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287952:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287959:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.287996:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.288022:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 16 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.288038:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856100992:0@lo:104: 00000100:00100000:3.0:1787430694.288102:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430694.288191:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.288200:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 16 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.288208:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101120:0@lo:104: 00010000:00010000:3.0:1787430694.288244:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.288252:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 16 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.288261:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101248:0@lo:104: 00010000:00010000:3.0:1787430694.288279:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.288287:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 16 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.288294:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101376:0@lo:104: 00010000:00010000:3.0:1787430694.288322:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.288380:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 16 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.288388:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101504:0@lo:104: 00000100:00100000:3.0:1787430694.288411:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430694.288515:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787430694.288532:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.288584:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.288629:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.288648:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856100992 00000100:00100000:1.0:1787430694.288661:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856100992 00000100:00100000:1.0:1787430694.288694:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101120 00000100:00100000:1.0:1787430694.288697:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101120 00000100:00100000:1.0:1787430694.288707:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101248 00000100:00100000:1.0:1787430694.288710:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101248 00000100:00100000:1.0:1787430694.288723:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430694.288731:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:5832:x1874256856100992:12345-0@lo:104: 00010000:00010000:1.0:1787430694.288743:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.288804:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430694.288810:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:5832:x1874256856100992:12345-0@lo:104: Request processed in 81us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.288815:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430694.288853:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430694.288858:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:5832:x1874256856101120:12345-0@lo:104: 00010000:00010000:1.0:1787430694.288864:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.288907:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430694.288912:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:5832:x1874256856101120:12345-0@lo:104: Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.288918:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430694.288929:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430694.288934:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5832:x1874256856101248:12345-0@lo:104: 00010000:00010000:1.0:1787430694.288941:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.288966:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787430694.288976:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5832:x1874256856101248:12345-0@lo:104: Request processed in 42us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.288981:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787430694.288995:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787430694.289001:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289007:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f302045400 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430694.289011:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289019:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430694.289026:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430694.289031:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430694.289057:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289062:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430694.289079:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289085:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f302045400/0x1fa5b1e070e68c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c20 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289096:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430694.289099:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289113:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75400 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430694.289116:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289122:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430694.289127:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430694.289131:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430694.289144:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289150:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430694.289165:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289170:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e68bef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289180:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430694.289183:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289188:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0031400 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430694.289190:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289207:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430694.289214:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430694.289219:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430694.289233:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289238:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430694.289243:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289250:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bda expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289261:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430694.289263:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430694.289265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430694.289273:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430694.289284:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856101632:0@lo:103: 00000100:00100000:1.0:1787430694.289315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.289368:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856101760:0@lo:103: 00000100:00100000:1.0:1787430694.289389:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.289405:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430694.289410:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856101888:0@lo:103: 00000100:00100000:1.0:1787430694.289427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.289459:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101632 00000100:00100000:1.0:1787430694.289463:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101632 00010000:00010000:1.0:1787430694.289481:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 17 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430694.289496:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101760 00000100:00100000:1.0:1787430694.289499:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101760 00010000:00010000:1.0:1787430694.289508:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 18 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430694.289518:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101888 00000100:00100000:1.0:1787430694.289520:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101888 00010000:00010000:1.0:1787430694.289529:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 19 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430694.289539:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430694.289544:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856101632:12345-0@lo:103: 00010000:00010000:1.0:1787430694.289553:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430694.289558:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 19 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289567:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 19 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289582:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430694.289609:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856101632:12345-0@lo:103: Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.289615:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430694.289626:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430694.289631:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:3307:x1874256856101760:12345-0@lo:103: 00010000:00010000:1.0:1787430694.289638:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430694.289648:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 18 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289656:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 18 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289665:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430694.289691:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:3307:x1874256856101760:12345-0@lo:103: Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.289697:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430694.289708:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430694.289714:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:3307:x1874256856101888:12345-0@lo:103: 00010000:00010000:1.0:1787430694.289721:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430694.289725:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 17 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289733:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 17 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.289741:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430694.289759:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:3307:x1874256856101888:12345-0@lo:103: Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.289764:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430694.289790:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856101632:0@lo:103: 00000100:00100000:1.0:1787430694.289808:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856101888:0@lo:103: 00000100:00100000:1.0:1787430694.289814:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856101760:0@lo:103: 00010000:00010000:2.0:1787430694.289874:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430694.290014:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a800/0x1fa5b1e070e68c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68c19 expref: 16 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.290025:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856100992:0@lo:104: 00010000:00010000:3.0:1787430694.290033:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68bef expref: 15 pid: 5832 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.290039:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101120:0@lo:104: 00010000:00010000:3.0:1787430694.290046:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68bd3 expref: 14 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.290054:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101248:0@lo:104: 00000100:00100000:0.0:1787430694.290142:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.290152:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101376 00000100:00100000:0.0:1787430694.290156:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101376 00000100:00100000:0.0:1787430694.290174:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856101504 00000100:00100000:0.0:1787430694.290176:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856101504 00000100:00100000:0.0:1787430694.290184:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430694.290190:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:5832:x1874256856101376:12345-0@lo:104: 00010000:00010000:0.0:1787430694.290203:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290288:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430694.290293:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:5832:x1874256856101376:12345-0@lo:104: Request processed in 103us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.290299:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430694.290312:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430694.290318:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5832:x1874256856101504:12345-0@lo:104: 00010000:00010000:0.0:1787430694.290341:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290373:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787430694.290378:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5832:x1874256856101504:12345-0@lo:104: Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.290384:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787430694.290398:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430694.290402:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290408:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f302045200 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430694.290412:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290420:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430694.290427:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430694.290438:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430694.290461:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290467:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430694.290478:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290486:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f302045200/0x1fa5b1e070e68ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68bb0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290496:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430694.290499:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290505:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74200 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430694.290509:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290516:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430694.290523:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430694.290529:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430694.290541:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290546:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430694.290558:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290565:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74200/0x1fa5b1e070e68b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b86 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290578:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430694.290580:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430694.290582:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430694.290591:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856102144:0@lo:103: 00000100:00100000:0.0:1787430694.290625:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.290653:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430694.290658:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856102016:0@lo:103: 00000100:00100000:0.0:1787430694.290678:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.290701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102144 00000100:00100000:0.0:1787430694.290705:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102144 00010000:00010000:0.0:1787430694.290720:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 14 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.290736:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102016 00000100:00100000:0.0:1787430694.290739:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102016 00010000:00010000:0.0:1787430694.290751:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 15 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.290764:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430694.290769:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:3310:x1874256856102144:12345-0@lo:103: 00010000:00010000:0.0:1787430694.290777:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430694.290781:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 15 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290800:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 15 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290812:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430694.290854:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:3310:x1874256856102144:12345-0@lo:103: Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.290861:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430694.290876:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430694.290894:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3310:x1874256856102016:12345-0@lo:103: 00010000:00010000:0.0:1787430694.290902:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430694.290905:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 14 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290914:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 14 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290926:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290934:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290947:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290954:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290961:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290973:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290978:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430694.290982:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290988:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.290997:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.291006:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430694.291029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3310:x1874256856102016:12345-0@lo:103: Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.291036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787430694.291119:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430694.291175:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856102016:0@lo:103: 00000100:00100000:1.0:1787430694.291198:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856102144:0@lo:103: 00010000:00010000:3.0:1787430694.291304:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68ba9 expref: 13 pid: 5831 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.291316:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101376:0@lo:104: 00010000:00010000:0.0:1787430694.291572:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0031000/0x1fa5b1e070e68b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68b7f expref: 12 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.291582:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874256856101504:0@lo:104: 00010000:00010000:0.0:1787430694.291605:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.291613:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.291620:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.291637:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e68c35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430694.291650:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787430694.323027:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:7630:x1874256856100864:12345-0@lo:253: Request processed in 42908us (43168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.323042:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787430694.323277:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856100864:0@lo:253: 10000000:01000000:2.0:1787430694.323292:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787430694.323295:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430694.323296:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787430694.323298:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430694.323299:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787430694.323301:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430694.323302:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430694.323303:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430694.323305:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787430694.323306:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430694.323308:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787430694.323570:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0f1c4de8800 from lustre-OST0001 10000000:01000000:2.0:1787430694.323595:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787430694.323597:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787430694.323605:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0f2c3458000 local copy 10000000:01000000:2.0:1787430694.323609:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787430694.323644:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.323655:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.323665:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430694.323681:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102272:0@lo:101: 00000100:00100000:2.0:1787430694.323732:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430694.323814:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.323850:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102272 00000100:00100000:3.0:1787430694.323857:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102272 00000100:00100000:3.0:1787430694.323934:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787430694.323944:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:7630:x1874256856102272:12345-0@lo:101: 00010000:00010000:3.0:1787430694.323955:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430694.323973:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68c3c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.323995:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c3c expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.324005:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c3c expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.324014:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147be00, rc 0) 00000100:00100000:3.0:1787430694.324044:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102272:12345-0@lo:101: Request processed in 102us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.324050:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787430694.324107:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102272:0@lo:101: 00010000:00010000:2.0:1787430694.324130:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.324139:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430694.324244:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102400:0@lo:501: 00000100:00100000:2.0:1787430694.324270:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430694.324286:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.324300:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102400 00000100:00100000:2.0:1787430694.324303:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102400 00000100:00100000:2.0:1787430694.324344:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787430694.324351:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102400:12345-0@lo:501: 00000100:00100000:2.0:1787430694.324570:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102400:12345-0@lo:501: Request processed in 219us (298us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787430694.324578:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787430694.324595:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102400:0@lo:501: 10000000:01000000:0.0:1787430694.324608:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787430694.324635:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787430694.324640:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.324647:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.324654:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.324685:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787430694.324705:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0f1c4de8800 10000000:01000000:0.0:1787430694.324710:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787430694.324715:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787430694.324718:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430694.324721:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787430694.324723:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787430694.324750:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.324764:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.324782:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.324795:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102528:0@lo:101: 00000100:00100000:0.0:1787430694.324822:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.324849:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5900 going to sleep for 11 seconds 00010000:00010000:2.0:1787430694.324976:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430694.324984:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.324992:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430694.324997:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.325006:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430694.325020:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430694.325026:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787430694.325037:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102528 00000100:00100000:1.0:1787430694.325043:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102528 00010000:00010000:2.0:1787430694.325048:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.325147:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787430694.325167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787430694.325170:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430694.325178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102528:12345-0@lo:101: 00010000:00010000:2.0:1787430694.325183:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1fa5b1e070e68c43 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.325188:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430694.325199:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430694.325199:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68c4a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.325203:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430694.325206:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430694.325217:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787430694.325221:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430694.325231:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856102656:0@lo:103: 00010000:00010000:1.0:1787430694.325240:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.325249:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302045400, rc 0) 00000100:00100000:2.0:1787430694.325269:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.325287:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856102528:12345-0@lo:101: Request processed in 112us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.325294:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787430694.325302:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102656 00000100:00100000:0.0:1787430694.325306:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102656 00000100:00100000:0.0:1787430694.325360:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430694.325367:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3308:x1874256856102656:12345-0@lo:103: 00010000:00010000:0.0:1787430694.325377:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430694.325388:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e68c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68c3c expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.325398:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430694.325447:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856102656:0@lo:103: 00000100:00100000:1.0:1787430694.325451:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102528:0@lo:101: 00010000:00010000:1.0:1787430694.325466:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.325475:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430694.325545:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102784:0@lo:501: 00000100:00100000:1.0:1787430694.325568:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.325593:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.325616:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102784 00000100:00100000:2.0:1787430694.325622:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102784 00000100:00100000:0.0:1787430694.325641:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:3308:x1874256856102656:12345-0@lo:103: Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.325651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430694.325658:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430694.325668:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102784:12345-0@lo:501: 00000100:00100000:2.0:1787430694.326469:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102784:12345-0@lo:501: Request processed in 801us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430694.326478:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787430694.326578:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102784:0@lo:501: 00000100:00100000:1.0:1787430694.326610:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102912:0@lo:503: 00000100:00100000:1.0:1787430694.326650:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.326717:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.326760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856102912 00000100:00100000:2.0:1787430694.326766:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856102912 00000100:00100000:2.0:1787430694.326949:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787430694.326960:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102912:12345-0@lo:503: 00000100:00100000:2.0:1787430694.327670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856102912:12345-0@lo:503: Request processed in 710us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430694.327680:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787430694.327741:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856102912:0@lo:503: 00000040:00080000:1.0:1787430694.328453:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430694.328524:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103040:0@lo:502: 00000100:00100000:1.0:1787430694.328576:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.328678:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.328684:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103040 00000100:00100000:2.0:1787430694.328692:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103040 00000100:00100000:2.0:1787430694.328727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787430694.328736:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856103040:12345-0@lo:502: 00000100:00100000:2.0:1787430694.329010:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856103040:12345-0@lo:502: Request processed in 274us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430694.329018:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787430694.329243:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103040:0@lo:502: 00000040:00080000:1.0:1787430694.329540:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787430694.329592:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787430694.329640:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787430694.329689:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787430694.329724:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787430694.329756:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787430694.329785:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103168:0@lo:502: 00000100:00100000:1.0:1787430694.329829:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.329865:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.331419:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103168 00000100:00100000:2.0:1787430694.331431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103168 00000100:00100000:2.0:1787430694.331492:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787430694.331502:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856103168:12345-0@lo:502: 00000100:00100000:2.0:1787430694.332412:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856103168:12345-0@lo:502: Request processed in 909us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430694.332422:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787430694.332686:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103168:0@lo:502: 00000040:00080000:3.0:1787430694.332840:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787430694.332855:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787430694.334433:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787430694.334458:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787430694.334466:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430694.334469:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787430694.334476:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787430694.334492:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0f2fe3699b8) 00000020:00000080:3.0:1787430694.334516:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787430694.334522:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787430694.334582:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f1c4de8800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787430694.334590:0:7637:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430694.334599:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1fa5b1e070e68c5f 00010000:00010000:3.0:1787430694.339216:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787430694.340096:0:7637:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787430694.346019:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787430694.347640:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787430694.354007:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787430694.354707:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787430694.359631:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787430694.359645:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430694.359653:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430694.359665:0:7637:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787430694.359670:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430694.359675:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430694.359676:0:7637:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430694.359680:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430694.359683:0:7637:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787430694.359746:0:7637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430694.359749:0:7637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430694.359750:0:7637:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787430694.359753:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787430694.359968:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787430694.360004:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787430694.360036:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.360049:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430694.360057:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c4de8800 from 1 10000000:01000000:2.0:1787430694.360060:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430694.360098:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.360107:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.360118:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430694.360141:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103296:0@lo:101: 00000100:00100000:2.0:1787430694.360220:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430694.360277:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.360311:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103296 00000100:00100000:3.0:1787430694.360319:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103296 00000100:00100000:2.0:1787430694.360435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787430694.360448:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:7630:x1874256856103296:12345-0@lo:101: 00010000:00010000:2.0:1787430694.360462:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430694.360476:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68c66 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.360948:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.360963:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.360980:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75800, rc 0) 00000100:00100000:2.0:1787430694.361031:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103296:12345-0@lo:101: Request processed in 586us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430694.361166:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787430694.361229:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103296:0@lo:101: 00010000:00010000:2.0:1787430694.361246:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.361256:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430694.361457:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103424:0@lo:501: 00000100:00100000:3.0:1787430694.361498:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430694.361534:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.361545:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103424 00000100:00100000:2.0:1787430694.361552:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103424 00000100:00100000:3.0:1787430694.361798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787430694.361808:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103424:12345-0@lo:501: 00000100:00100000:3.0:1787430694.362059:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103424:12345-0@lo:501: Request processed in 252us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.362140:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787430694.362217:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103424:0@lo:501: 00000100:00100000:2.0:1787430694.362448:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103552:0@lo:503: 00000100:00100000:2.0:1787430694.362489:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430694.362920:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.363003:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103552 00000100:00100000:3.0:1787430694.363009:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103552 00000100:00100000:3.0:1787430694.363042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787430694.363049:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103552:12345-0@lo:503: 00000100:00100000:3.0:1787430694.363419:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103552:12345-0@lo:503: Request processed in 369us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.363426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787430694.363458:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103552:0@lo:503: 00000040:00080000:1.0:1787430694.363905:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430694.363972:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103680:0@lo:502: 00000100:00100000:1.0:1787430694.364015:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.364090:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.365211:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103680 00000100:00100000:3.0:1787430694.365222:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103680 00000100:00100000:3.0:1787430694.365265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787430694.365281:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103680:12345-0@lo:502: 00000100:00100000:3.0:1787430694.365648:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103680:12345-0@lo:502: Request processed in 368us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.365656:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430694.365736:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103680:0@lo:502: 00000040:00080000:1.0:1787430694.366140:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787430694.366211:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787430694.366252:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103808:0@lo:502: 00000100:00100000:1.0:1787430694.366299:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.366365:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.366472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103808 00000100:00100000:3.0:1787430694.366478:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103808 00000100:00100000:3.0:1787430694.366518:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787430694.366527:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103808:12345-0@lo:502: 00000100:00100000:3.0:1787430694.366684:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103808:12345-0@lo:502: Request processed in 157us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.366691:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787430694.366722:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103808:0@lo:502: 00000040:00080000:1.0:1787430694.366809:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787430694.366996:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787430694.367813:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430694.367825:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430694.367827:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787430694.367835:0:7641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f1c4de8800 00000020:00000080:3.0:1787430694.367837:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430694.367858:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430694.367861:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430694.367863:0:7641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787430694.367867:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787430694.369993:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787430694.370049:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430694.370079:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.370094:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430694.370401:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787430694.370405:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0f1c4de8800 10000000:01000000:0.0:1787430694.370409:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0f1c4de8800 10000000:01000000:0.0:1787430694.370414:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430694.370422:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f1c4de8800 from 1 10000000:01000000:0.0:1787430694.370426:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430694.370468:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.370478:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.370491:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.370521:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103936:0@lo:101: 00000100:00100000:0.0:1787430694.370659:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.370748:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.370802:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856103936 00000100:00100000:3.0:1787430694.370810:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856103936 00000100:00100000:3.0:1787430694.370862:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787430694.370873:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856103936:12345-0@lo:101: 00010000:00010000:3.0:1787430694.370897:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430694.370911:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68c74 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.370936:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.370958:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.370966:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430694.371064:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856103936:12345-0@lo:101: Request processed in 192us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.371072:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430694.371235:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856103936:0@lo:101: 00010000:00010000:0.0:1787430694.371249:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.371258:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.371523:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104064:0@lo:501: 00000100:00100000:0.0:1787430694.371554:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.371624:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.371662:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104064 00000100:00100000:3.0:1787430694.371667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104064 00000100:00100000:3.0:1787430694.371695:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787430694.371702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104064:12345-0@lo:501: 00000100:00100000:3.0:1787430694.372004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104064:12345-0@lo:501: Request processed in 301us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.372013:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787430694.372068:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104064:0@lo:501: 00000100:00100000:0.0:1787430694.372099:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104192:0@lo:503: 00000100:00100000:0.0:1787430694.372223:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.372285:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.373478:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104192 00000100:00100000:3.0:1787430694.373487:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104192 00000100:00100000:3.0:1787430694.373532:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787430694.373541:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104192:12345-0@lo:503: 00000100:00100000:3.0:1787430694.373795:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104192:12345-0@lo:503: Request processed in 255us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.373803:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787430694.373998:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104192:0@lo:503: 00000040:00080000:0.0:1787430694.374967:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430694.375068:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104320:0@lo:502: 00000100:00100000:0.0:1787430694.375596:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.375676:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.375725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104320 00000100:00100000:3.0:1787430694.375732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104320 00000100:00100000:3.0:1787430694.375777:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787430694.375786:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104320:12345-0@lo:502: 00000100:00100000:3.0:1787430694.376070:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104320:12345-0@lo:502: Request processed in 284us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.376084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787430694.376625:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104320:0@lo:502: 00000040:00080000:0.0:1787430694.377211:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787430694.377784:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787430694.377839:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787430694.377910:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787430694.377951:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787430694.378009:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787430694.378049:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787430694.378086:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787430694.378497:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787430694.378542:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787430694.378577:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787430694.378649:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787430694.378688:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787430694.378718:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787430694.378766:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787430694.378798:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787430694.378848:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787430694.378912:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787430694.378949:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787430694.378983:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787430694.379030:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787430694.379066:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787430694.379100:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787430694.379246:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787430694.379492:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787430694.379534:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787430694.379600:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787430694.379639:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787430694.379672:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787430694.379723:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787430694.379761:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787430694.379791:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787430694.379840:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787430694.379948:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787430694.379989:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787430694.380040:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787430694.380077:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787430694.380129:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104448:0@lo:502: 00000100:00100000:1.0:1787430694.380221:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.380385:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.380542:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104448 00000100:00100000:3.0:1787430694.380550:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104448 00000100:00100000:3.0:1787430694.380612:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430694.380622:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104448:12345-0@lo:502: 00000100:00100000:3.0:1787430694.380950:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856104448:12345-0@lo:502: Request processed in 328us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.380958:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787430694.381137:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856104448:0@lo:502: 00000040:00080000:1.0:1787430694.381216:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787430694.381228:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787430694.382230:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787430694.382245:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0f2fe36cd28) 00000020:00000080:3.0:1787430694.382273:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787430694.382624:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f1c4de8800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787430694.382629:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f1c4de8800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787430694.382632:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f1c4de8800 3 00010000:00080000:3.0:1787430694.382671:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2d0495800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787430694.385670:0:7642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787430694.385891:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787430694.385932:0:7642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787430694.385950:0:7642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1fa5b1e070e68c89 00000100:00080000:3.0:1787430694.385964:0:7642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430694.385973:0:7642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0f2d0495800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430694.386024:0:7642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2ec22d180 x1874256856104576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430694.386126:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1874256856104576:0@lo:38: 00000100:00100000:1.0:1787430694.386210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.386322:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104576 00000100:00100000:0.0:1787430694.386349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104576 00000100:00100000:0.0:1787430694.386385:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430694.386393:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1874256856104576:12345-0@lo:38: 00010000:00080000:0.0:1787430694.386417:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1787430694.386446:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1fa5b1e070e68c90 00000004:00100000:0.0:1787430694.386462:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787430694.386497:0:5838:0:(import.c:65:import_set_state_nolock()) ffffa0f2c346e800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787430694.386653:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787430694.386753:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856104960:0@lo:400: 00000100:00100000:3.0:1787430694.386789:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430694.386817:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430694.386931:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856104832:0@lo:400: 00000100:00100000:3.0:1787430694.386959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430694.386989:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104832 00000100:00100000:3.0:1787430694.386993:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104832 00000100:00100000:3.0:1787430694.387038:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430694.387045:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856104832:12345-0@lo:400: 00000100:00100000:3.0:1787430694.387108:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856104832:12345-0@lo:400: Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.387125:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787430694.387170:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2ec22f480 x1874256856104832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430694.387185:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856104832:0@lo:400: 00000100:00100000:3.0:1787430694.387653:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856104704:0@lo:400: 00000100:00100000:3.0:1787430694.387694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430694.387726:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104704 00000100:00100000:3.0:1787430694.387730:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104704 00000100:00100000:3.0:1787430694.387774:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430694.387780:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856104704:12345-0@lo:400: 00000100:00100000:3.0:1787430694.387817:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856104704:12345-0@lo:400: Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430694.387824:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787430694.387853:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2ec22e680 x1874256856104704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430694.387863:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856104704:0@lo:400: 00000100:00100000:0.0:1787430694.387942:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874256856104576:12345-0@lo:38: Request processed in 1548us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.387949:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430694.387983:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856104960 00000100:00100000:0.0:1787430694.387987:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856104960 00000100:00100000:0.0:1787430694.388063:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430694.388071:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856104960:12345-0@lo:400: 00000100:00100000:0.0:1787430694.388185:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856104960:12345-0@lo:400: Request processed in 116us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.388193:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787430694.388269:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2ec22d180 x1874256856104576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430694.388290:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430694.388299:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787430694.388309:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787430694.388313:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787430694.388317:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2d0495800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787430694.388371:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1874256856104576:0@lo:38: 00000100:00080000:0.0:1787430694.388535:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430694.388540:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787430694.388562:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2ec22f100 x1874256856104960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430694.388571:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787430694.388581:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856104960:0@lo:400: 00000040:00080000:3.0:1787430694.389454:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787430694.389717:0:7643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1874256856105088:0@lo:901: 00000100:00100000:1.0:1787430694.389777:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430694.389807:0:7643:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430694.389895:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105088 00000100:00100000:2.0:1787430694.389904:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105088 00000100:00100000:2.0:1787430694.389970:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787430694.389977:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430694.389983:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1874256856105088:12345-0@lo:901: 00000020:01000000:0.0:1787430694.390612:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787430694.390653:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430694.390680:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.390701:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787430694.390758:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787430694.390761:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787430694.390762:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430694.390763:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430694.390764:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430694.390766:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430694.390767:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430694.390769:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430694.390770:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430694.390772:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430694.390773:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430694.390778:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787430694.390781:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787430694.390782:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787430694.390783:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430694.390789:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430694.390790:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430694.390791:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430694.390792:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787430694.390793:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787430694.390794:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787430694.390795:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430694.390795:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787430694.390811:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787430694.390824:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856105216:0@lo:253: 00000100:00100000:0.0:1787430694.390875:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.390918:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430694.390938:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105216 00000100:00100000:3.0:1787430694.390951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105216 00000100:00100000:3.0:1787430694.391004:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787430694.391011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:7630:x1874256856105216:12345-0@lo:253: 20000000:01000000:3.0:1787430694.391034:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787430694.391052:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787430694.392287:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1874256856105088:12345-0@lo:901: Request processed in 2300us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430694.392299:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787430694.392385:0:7643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2feedf480 x1874256856105088/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787430710 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430694.392423:0:7643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1874256856105088:0@lo:901: 20000000:01000000:1.0:1787430694.421072:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787430694.421093:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787430694.421186:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787430694.421192:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787430694.421215:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.421238:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.421246:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.421302:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430694.421317:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 14 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430694.421351:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874256856105344:0@lo:104: 00000100:00100000:2.0:1787430694.421431:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430694.421487:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430694.421535:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105344 00000100:00100000:1.0:1787430694.421542:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105344 00000100:00100000:1.0:1787430694.421598:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430694.421607:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5853:x1874256856105344:12345-0@lo:104: 00010000:00010000:1.0:1787430694.421619:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430694.421677:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874256856105344:0@lo:104: 00010000:00010000:1.0:1787430694.421680:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430694.421685:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:5853:x1874256856105344:12345-0@lo:104: Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430694.421692:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787430694.421698:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.421744:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430694.421750:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.421758:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430694.421762:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.421770:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430694.421777:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430694.421782:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430694.421818:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.421825:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430694.421849:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.421856:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e68be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68be8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430694.421873:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430694.421902:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430694.421904:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430694.421913:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430694.421925:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856105472:0@lo:103: 00000100:00100000:3.0:1787430694.421990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430694.422450:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105472 00000100:00100000:0.0:1787430694.422456:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105472 00010000:00010000:0.0:1787430694.422478:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 15 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.422505:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430694.422513:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:3308:x1874256856105472:12345-0@lo:103: 00010000:00010000:0.0:1787430694.422524:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430694.422529:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 15 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422540:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 15 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422553:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302044a00/0x1fa5b1e070e68be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68be1 expref: 15 pid: 5830 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422568:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422575:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430694.422603:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001447111s 00010000:00010000:0.0:1787430694.422607:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422614:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422621:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422627:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422632:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430694.422636:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422643:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422665:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430694.422676:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430694.422716:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3308:x1874256856105472:12345-0@lo:103: Request processed in 204us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.422723:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787430694.422737:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.422745:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430694.422750:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e68c97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430694.422777:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856105472:0@lo:103: 00000100:00100000:0.0:1787430694.429929:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:7630:x1874256856105216:12345-0@lo:253: Request processed in 38908us (39042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430694.429961:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787430694.430065:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:839a7a74-1b4a-4cd3-9548-e5ffe194716c:7630:1874256856105216:0@lo:253: 10000000:01000000:1.0:1787430694.430081:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787430694.430090:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787430694.430092:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430694.430094:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430694.430095:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430694.430096:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430694.430098:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430694.430099:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430694.430101:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787430694.430102:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787430694.430104:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430694.430105:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787430694.430122:0:7630:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787430694.435236:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787430694.435963:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787430694.436195:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787430694.436416:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787430694.436605:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787430694.437039:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787430694.438726:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787430694.587260:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787430694.587269:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787430694.587300:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787430694.587389:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787430694.587421:0:7630:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787430694.587451:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787430694.940474:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430695.133665:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430695.133692:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856105600:0@lo:13: 00000100:00100000:2.0:1787430695.133771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430695.133946:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105600 00000100:00100000:0.0:1787430695.133955:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105600 00000100:00100000:0.0:1787430695.134019:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430695.134030:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856105600:12345-0@lo:13: 00002000:00000024:0.0:1787430695.134068:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430695.134173:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856105600:12345-0@lo:13: Request processed in 144us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430695.134181:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787430695.134640:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73cce00 x1874256856105600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430695.134661:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856105600:0@lo:13: 00010000:00010000:3.0:1787430695.964648:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430696.988449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430697.987493:0:7985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787430698.012513:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430699.036593:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430699.740572:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856105728:0@lo:400: 00000100:00100000:1.0:1787430699.740572:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856105856:0@lo:400: 00000100:00100000:1.0:1787430699.740708:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430699.740760:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105856 00000100:00100000:0.0:1787430699.740769:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105856 00000100:00100000:3.0:1787430699.740771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430699.740818:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856106112:0@lo:400: 00000100:00100000:3.0:1787430699.740822:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856106240:0@lo:400: 00000100:00100000:0.0:1787430699.740840:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787430699.740852:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856105856:12345-0@lo:400: 00000100:00100000:1.0:1787430699.740863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430699.740868:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430699.740895:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430699.740905:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856105984:0@lo:400: 00000100:00100000:3.0:1787430699.740918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105728 00000100:00100000:0.0:1787430699.740920:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856105856:12345-0@lo:400: Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430699.740925:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105728 00000100:00100000:0.0:1787430699.740931:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430699.740936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430699.740965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787430699.740974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3309:x1874256856105728:12345-0@lo:400: 00010000:00080000:1.0:1787430699.740983:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2feedc700 x1874256856105856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430699.740996:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856105856:0@lo:400: 00000100:00100000:3.0:1787430699.741031:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3309:x1874256856105728:12345-0@lo:400: Request processed in 56us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430699.741039:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787430699.741043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106240 00000100:00100000:1.0:1787430699.741048:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106240 00000100:00100000:3.0:1787430699.741076:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856105984 00000100:00100000:3.0:1787430699.741083:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856105984 00000100:00100000:1.0:1787430699.741084:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430699.741096:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856106240:12345-0@lo:400: 00000100:00100000:3.0:1787430699.741112:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430699.741121:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856105984:12345-0@lo:400: 00000100:00100000:1.0:1787430699.741133:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856106240:12345-0@lo:400: Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430699.741140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787430699.741166:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430699.741168:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856105984:12345-0@lo:400: Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430699.741187:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430699.741207:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106112 00000100:00100000:1.0:1787430699.741211:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106112 00000100:00100000:3.0:1787430699.741224:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856105728:0@lo:400: 00010000:00080000:3.0:1787430699.741243:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2feedfb80 x1874256856106240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430699.741252:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856106240:0@lo:400: 00000100:00100000:1.0:1787430699.741257:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430699.741267:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856106112:12345-0@lo:400: 00000100:00100000:1.0:1787430699.741301:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856106112:12345-0@lo:400: Request processed in 36us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430699.741308:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787430699.741324:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787430699.741570:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2feeddf80 x1874256856105984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430699.742663:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856105984:0@lo:400: 00010000:00080000:0.0:1787430699.742684:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2feeded80 x1874256856106112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430699.742692:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856106112:0@lo:400: 00010000:00010000:3.0:1787430700.060679:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430700.256477:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430700.256501:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856106368:0@lo:13: 00000100:00100000:0.0:1787430700.256583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430700.256642:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106368 00000100:00100000:0.0:1787430700.256655:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106368 00000100:00100000:0.0:1787430700.256700:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430700.256711:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856106368:12345-0@lo:13: 00002000:00000024:0.0:1787430700.256745:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430700.256812:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856106368:12345-0@lo:13: Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430700.256820:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787430700.256847:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73ce300 x1874256856106368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430700.256865:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856106368:0@lo:13: 00010000:00010000:1.0:1787430701.084428:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787430701.276965:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787430701.276973:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2c562b800 from 30 10000000:01000000:0.0:1787430701.276978:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430701.277024:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.277035:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.277046:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430701.277072:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856106496:0@lo:101: 00000100:00100000:0.0:1787430701.277139:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.277186:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430701.277210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106496 00000100:00100000:0.0:1787430701.277217:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106496 00000100:00100000:0.0:1787430701.277263:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787430701.277285:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856106496:12345-0@lo:101: 00010000:00010000:0.0:1787430701.277299:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430701.277324:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.277365:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.277377:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.277387:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0031600, rc 0) 00000100:00100000:0.0:1787430701.277425:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856106496:12345-0@lo:101: Request processed in 141us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.277432:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787430701.277474:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856106496:0@lo:101: 00010000:00010000:0.0:1787430701.277488:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.277497:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430701.277544:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856106624:0@lo:501: 00000100:00100000:0.0:1787430701.277567:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.277580:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430701.277912:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106624 00000100:00100000:3.0:1787430701.277917:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106624 00000100:00100000:3.0:1787430701.277943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787430701.277950:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856106624:12345-0@lo:501: 00000100:00100000:3.0:1787430701.278296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856106624:12345-0@lo:501: Request processed in 345us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430701.278304:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787430701.278428:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856106624:0@lo:501: 00000100:00100000:0.0:1787430701.278458:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856106752:0@lo:503: 00000100:00100000:0.0:1787430701.278496:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.278519:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430701.278533:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106752 00000100:00100000:0.0:1787430701.278545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106752 00000100:00100000:0.0:1787430701.278573:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787430701.278580:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856106752:12345-0@lo:503: 00000100:00100000:0.0:1787430701.278907:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856106752:12345-0@lo:503: Request processed in 324us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.278915:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787430701.278957:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856106752:0@lo:503: 00000100:00100000:3.0:1787430701.280121:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8163:1874256856106880:0@lo:502: 00000100:00100000:3.0:1787430701.280177:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.280205:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.280674:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856106880 00000100:00100000:1.0:1787430701.280681:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856106880 00000100:00100000:1.0:1787430701.280726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787430701.280785:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8163:x1874256856106880:12345-0@lo:502: 00000100:00100000:1.0:1787430701.281186:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8163:x1874256856106880:12345-0@lo:502: Request processed in 450us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.281193:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787430701.281294:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8163:1874256856106880:0@lo:502: 00000100:00100000:3.0:1787430701.281378:0:8163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8163:1874256856107008:0@lo:502: 00000100:00100000:3.0:1787430701.281415:0:8163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.281438:0:8163:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.281562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107008 00000100:00100000:1.0:1787430701.281567:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107008 00000100:00100000:1.0:1787430701.281594:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787430701.281601:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8163:x1874256856107008:12345-0@lo:502: 00000100:00100000:1.0:1787430701.281739:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8163:x1874256856107008:12345-0@lo:502: Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.281756:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787430701.281905:0:8163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8163:1874256856107008:0@lo:502: 00000040:00080000:3.0:1787430701.281924:0:8163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787430701.282994:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787430701.283024:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430701.283038:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.283052:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430701.283063:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787430701.283066:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787430701.283069:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430701.283104:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.283112:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.283121:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430701.283140:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107136:0@lo:101: 00000100:00100000:0.0:1787430701.283196:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.283250:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.286070:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107136 00000100:00100000:1.0:1787430701.286085:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107136 00000100:00100000:1.0:1787430701.286136:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787430701.286145:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856107136:12345-0@lo:101: 00010000:00010000:1.0:1787430701.286162:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430701.286179:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68cac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.286206:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.286216:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.286225:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302044000, rc 0) 00000100:00100000:1.0:1787430701.286300:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856107136:12345-0@lo:101: Request processed in 155us (3103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.286306:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787430701.286383:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107136:0@lo:101: 00010000:00010000:0.0:1787430701.286404:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.286415:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430701.286495:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107264:0@lo:501: 00000100:00100000:0.0:1787430701.286530:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.286565:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.286703:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107264 00000100:00100000:2.0:1787430701.286708:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107264 00000100:00100000:2.0:1787430701.286738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787430701.286755:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856107264:12345-0@lo:501: 00000100:00100000:2.0:1787430701.286982:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856107264:12345-0@lo:501: Request processed in 238us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.286989:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787430701.287098:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107264:0@lo:501: 00000100:00100000:0.0:1787430701.287130:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107392:0@lo:503: 00000100:00100000:0.0:1787430701.287177:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.287205:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.287286:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107392 00000100:00100000:1.0:1787430701.287291:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107392 00000100:00100000:1.0:1787430701.287319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787430701.287342:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856107392:12345-0@lo:503: 00000100:00100000:1.0:1787430701.287631:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856107392:12345-0@lo:503: Request processed in 306us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.287638:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787430701.287761:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107392:0@lo:503: 00000100:00100000:2.0:1787430701.289471:0:8164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8164:1874256856107520:0@lo:502: 00000100:00100000:2.0:1787430701.289534:0:8164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.289581:0:8164:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.289627:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107520 00000100:00100000:1.0:1787430701.289633:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107520 00000100:00100000:1.0:1787430701.289679:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787430701.289687:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8164:x1874256856107520:12345-0@lo:502: 00000100:00100000:1.0:1787430701.289926:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8164:x1874256856107520:12345-0@lo:502: Request processed in 238us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.289933:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787430701.290015:0:8164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8164:1874256856107520:0@lo:502: 00000020:01000000:2.0:1787430701.290040:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430701.290048:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430701.290050:0:8164:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787430701.290055:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787430701.290057:0:8164:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787430701.290072:0:8164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8164:1874256856107648:0@lo:502: 00000100:00100000:2.0:1787430701.290102:0:8164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.290123:0:8164:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.290229:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107648 00000100:00100000:1.0:1787430701.290233:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107648 00000100:00100000:1.0:1787430701.290263:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787430701.290271:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8164:x1874256856107648:12345-0@lo:502: 00000100:00100000:1.0:1787430701.290407:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8164:x1874256856107648:12345-0@lo:502: Request processed in 137us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.290414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787430701.290496:0:8164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8164:1874256856107648:0@lo:502: 00000020:01000000:2.0:1787430701.290514:0:8164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430701.290523:0:8164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430701.290525:0:8164:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787430701.290528:0:8164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787430701.290673:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787430701.290690:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787430701.290699:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.290710:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430701.290720:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787430701.290723:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2d0492800 from 30 10000000:01000000:1.0:1787430701.290726:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430701.290765:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.290774:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.290782:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430701.290794:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107776:0@lo:101: 00000100:00100000:1.0:1787430701.290824:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.290847:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fde63900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.290938:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107776 00000100:00100000:2.0:1787430701.290943:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107776 00000100:00100000:2.0:1787430701.290972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787430701.290979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856107776:12345-0@lo:101: 00010000:00010000:2.0:1787430701.290987:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430701.291000:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68cba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.291019:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.291029:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.291038:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74a00, rc 0) 00000100:00100000:2.0:1787430701.291071:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856107776:12345-0@lo:101: Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.291077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787430701.291106:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107776:0@lo:101: 00010000:00010000:2.0:1787430701.291117:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.291125:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430701.291161:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107904:0@lo:501: 00000100:00100000:2.0:1787430701.291193:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.291206:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.291218:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856107904 00000100:00100000:2.0:1787430701.291221:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856107904 00000100:00100000:2.0:1787430701.291241:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787430701.291247:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856107904:12345-0@lo:501: 00000100:00100000:2.0:1787430701.291453:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856107904:12345-0@lo:501: Request processed in 205us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.291460:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787430701.291487:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856107904:0@lo:501: 00000100:00100000:2.0:1787430701.291507:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108032:0@lo:503: 00000100:00100000:2.0:1787430701.291643:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.291664:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.291697:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108032 00000100:00100000:1.0:1787430701.291700:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108032 00000100:00100000:1.0:1787430701.291729:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787430701.291736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856108032:12345-0@lo:503: 00000100:00100000:1.0:1787430701.291861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856108032:12345-0@lo:503: Request processed in 125us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.291867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787430701.291955:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108032:0@lo:503: 00000100:00100000:2.0:1787430701.292230:0:8165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8165:1874256856108160:0@lo:502: 00000100:00100000:2.0:1787430701.292262:0:8165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.292274:0:8165:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.292398:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108160 00000100:00100000:1.0:1787430701.292402:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108160 00000100:00100000:1.0:1787430701.292426:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787430701.292433:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8165:x1874256856108160:12345-0@lo:502: 00000100:00100000:1.0:1787430701.292600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8165:x1874256856108160:12345-0@lo:502: Request processed in 165us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.292607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787430701.292755:0:8165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8165:1874256856108160:0@lo:502: 00000100:00100000:2.0:1787430701.292794:0:8165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8165:1874256856108288:0@lo:502: 00000100:00100000:2.0:1787430701.292825:0:8165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.292842:0:8165:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430701.293038:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108288 00000100:00100000:0.0:1787430701.293042:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108288 00000100:00100000:0.0:1787430701.293066:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787430701.293073:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8165:x1874256856108288:12345-0@lo:502: 00000100:00100000:0.0:1787430701.293210:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8165:x1874256856108288:12345-0@lo:502: Request processed in 137us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.293216:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787430701.293273:0:8165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8165:1874256856108288:0@lo:502: 00000040:00080000:2.0:1787430701.293291:0:8165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787430701.293501:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787430701.293521:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430701.293530:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.293619:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430701.293629:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787430701.293631:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f2d0492800 from 5 10000000:01000000:1.0:1787430701.293634:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787430701.293660:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.293667:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.293675:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430701.293688:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108416:0@lo:101: 00000100:00100000:1.0:1787430701.293717:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.293786:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fde633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.296012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108416 00000100:00100000:2.0:1787430701.296033:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108416 00000100:00100000:2.0:1787430701.296086:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787430701.296096:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856108416:12345-0@lo:101: 00010000:00010000:2.0:1787430701.296112:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430701.296224:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e68ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.296251:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e68ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cc8 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.296262:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e68ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cc8 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.296270:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75c00, rc 0) 00000100:00100000:2.0:1787430701.296393:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856108416:12345-0@lo:101: Request processed in 299us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.296401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787430701.296467:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108416:0@lo:101: 00010000:00010000:1.0:1787430701.296484:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.296493:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430701.296620:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108544:0@lo:256: 00000100:00100000:1.0:1787430701.296657:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.296729:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fde633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.296766:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108544 00000100:00100000:2.0:1787430701.296770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108544 00000100:00100000:2.0:1787430701.296827:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787430701.296835:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856108544:12345-0@lo:256: 20000000:01000000:2.0:1787430701.296848:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787430701.296865:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787430701.296868:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787430701.296951:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856108544:12345-0@lo:256: Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.296959:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787430701.297054:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108544:0@lo:256: 10000000:01000000:0.0:1787430701.297095:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430701.297102:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.297115:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430701.297123:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787430701.297126:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787430701.297129:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430701.297150:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.297158:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.297166:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430701.297177:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108672:0@lo:101: 00000100:00100000:0.0:1787430701.297202:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.297227:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.297357:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108672 00000100:00100000:2.0:1787430701.297362:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108672 00000100:00100000:2.0:1787430701.297401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787430701.297408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856108672:12345-0@lo:101: 00010000:00010000:2.0:1787430701.297415:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430701.297425:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.297440:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.297449:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.297456:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430701.297484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856108672:12345-0@lo:101: Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.297489:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787430701.297569:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108672:0@lo:101: 00010000:00010000:0.0:1787430701.297866:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430701.297875:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430701.297923:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108800:0@lo:501: 00000100:00100000:0.0:1787430701.298152:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.298225:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.298258:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108800 00000100:00100000:2.0:1787430701.298263:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108800 00000100:00100000:2.0:1787430701.298300:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787430701.298308:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856108800:12345-0@lo:501: 00000100:00100000:2.0:1787430701.298708:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856108800:12345-0@lo:501: Request processed in 400us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.298716:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787430701.298775:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108800:0@lo:501: 00000100:00100000:0.0:1787430701.298803:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108928:0@lo:503: 00000100:00100000:0.0:1787430701.298836:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.298857:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.298904:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856108928 00000100:00100000:1.0:1787430701.298909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856108928 00000100:00100000:1.0:1787430701.298946:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787430701.298953:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856108928:12345-0@lo:503: 00000100:00100000:1.0:1787430701.299302:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856108928:12345-0@lo:503: Request processed in 348us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.299309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787430701.299369:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856108928:0@lo:503: 00000100:00100000:0.0:1787430701.303396:0:8166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8166:1874256856109056:0@lo:502: 00000100:00100000:0.0:1787430701.303474:0:8166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.303511:0:8166:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.303513:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109056 00000100:00100000:1.0:1787430701.303520:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109056 00000100:00100000:1.0:1787430701.303578:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787430701.303588:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8166:x1874256856109056:12345-0@lo:502: 00000100:00100000:1.0:1787430701.303898:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8166:x1874256856109056:12345-0@lo:502: Request processed in 312us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.303905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787430701.305096:0:8166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8166:1874256856109056:0@lo:502: 00000020:01000000:0.0:1787430701.305134:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787430701.305141:0:8166:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787430701.305149:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430701.305151:0:8166:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787430701.305156:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787430701.305160:0:8166:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787430701.305183:0:8166:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787430701.305186:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430701.305201:0:8166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0f2ed328000) 00000020:00000080:0.0:1787430701.305239:0:8166:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787430701.305245:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787430701.305341:0:8166:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787430701.305347:0:8166:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787430701.305354:0:8166:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e68ceb 00010000:00080000:0.0:1787430701.305383:0:8166:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2c622c000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787430701.305582:0:8166:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787430701.306240:0:8166:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787430701.306259:0:8166:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787430701.306964:0:8166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430701.308502:0:8166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430701.308644:0:8166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787430701.308708:0:8166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787430701.310939:0:8168:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430701.310957:0:8168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787430701.311698:0:8166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787430701.311710:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787430701.311754:0:8166:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787430701.311777:0:8166:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e68cf2 00000100:00080000:3.0:1787430701.311788:0:8166:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430701.311793:0:8166:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0f2c622c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430701.311827:0:8166:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2ec22ed80 x1874256856109184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430701.311854:0:8166:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787430701.312103:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430701.312107:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430701.312109:0:8166:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787430701.312112:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430701.312116:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430701.312118:0:8166:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430701.312121:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430701.312123:0:8166:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787430701.312150:0:8166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8166:1874256856109312:0@lo:502: 00000100:00100000:3.0:1787430701.312240:0:8166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.312492:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856109184:0@lo:8: 00000100:00100000:1.0:1787430701.312528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.312569:0:8166:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.312676:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109312 00000100:00100000:2.0:1787430701.312683:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109312 00000100:00100000:2.0:1787430701.312728:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787430701.312737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8166:x1874256856109312:12345-0@lo:502: 00000100:00100000:0.0:1787430701.312800:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856109568:0@lo:400: 00000100:00100000:0.0:1787430701.312831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.312861:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430701.312867:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856109440:0@lo:400: 00000100:00100000:1.0:1787430701.313008:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856109696:0@lo:400: 00000100:00100000:3.0:1787430701.313034:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109568 00000100:00100000:1.0:1787430701.313037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.313038:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109568 00000100:00100000:1.0:1787430701.313057:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430701.313062:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856109824:0@lo:400: 00000100:00100000:3.0:1787430701.313073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430701.313080:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856109568:12345-0@lo:400: 00000100:00100000:1.0:1787430701.313081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.313105:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109184 00000100:00100000:1.0:1787430701.313108:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109184 00000100:00100000:3.0:1787430701.313112:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856109568:12345-0@lo:400: Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430701.313118:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430701.313126:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109696 00000100:00100000:1.0:1787430701.313128:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109696 00000100:00100000:3.0:1787430701.313131:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109824 00000100:00100000:3.0:1787430701.313133:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109824 00000100:00100000:1.0:1787430701.313146:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430701.313151:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856109696:12345-0@lo:400: 00000100:00100000:3.0:1787430701.313159:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430701.313163:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856109824:12345-0@lo:400: 00000100:00100000:2.0:1787430701.313211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8166:x1874256856109312:12345-0@lo:502: Request processed in 474us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.313211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.313223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1787430701.313235:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73cce00 x1874256856109568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430701.313250:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856109568:0@lo:400: 00000100:00100000:0.0:1787430701.313275:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109440 00000100:00100000:0.0:1787430701.313278:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109440 00000100:00100000:0.0:1787430701.313296:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430701.313301:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856109440:12345-0@lo:400: 00000100:00100000:0.0:1787430701.313348:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856109440:12345-0@lo:400: Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.313354:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787430701.313378:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73ce300 x1874256856109440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430701.313387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856109440:0@lo:400: 00000100:00100000:3.0:1787430701.313460:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856109824:12345-0@lo:400: Request processed in 295us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430701.313466:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430701.313491:0:8166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8166:1874256856109312:0@lo:502: 00000020:01000000:3.0:1787430701.313514:0:8166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430701.313521:0:8166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430701.313524:0:8166:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787430701.313529:0:8166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1787430701.314059:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856109696:12345-0@lo:400: Request processed in 906us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.314066:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430701.314082:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430701.314086:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1874256856109184:12345-0@lo:8: 00010000:00080000:1.0:1787430701.314110:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1787430701.314141:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e68cf9 00002000:00100000:1.0:1787430701.314159:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0f2fe473000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787430701.314163:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787430701.314167:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787430701.314294:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787430701.314465:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430701.314469:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1787430701.314876:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787430701.314902:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe471800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430701.315019:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874256856109184:12345-0@lo:8: Request processed in 930us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.315027:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787430701.315071:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73cdc00 x1874256856109824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430701.315083:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856109824:0@lo:400: 00010000:00080000:1.0:1787430701.315094:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73cc380 x1874256856109696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430701.315102:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856109696:0@lo:400: 00000020:01000000:1.0:1787430701.315129:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787430701.315154:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787430701.315164:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.315181:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430701.315192:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787430701.315194:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0f2c3458000 from 1 10000000:01000000:1.0:1787430701.315197:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787430701.315228:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.315236:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.315246:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430701.315263:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856109952:0@lo:101: 00000100:00100000:1.0:1787430701.315297:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.315357:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.315439:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856109952 00000100:00100000:2.0:1787430701.315445:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856109952 00000100:00100000:2.0:1787430701.315479:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787430701.315487:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856109952:12345-0@lo:101: 00010000:00010000:2.0:1787430701.315497:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430701.315512:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68d00 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.315662:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.315676:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430701.315685:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75600, rc 0) 00000100:00100000:2.0:1787430701.315775:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856109952:12345-0@lo:101: Request processed in 288us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.315781:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1787430701.315871:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec22ed80 x1874256856109184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430701.315891:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430701.315899:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787430701.315906:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787430701.315911:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787430701.315913:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787430701.315935:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787430701.315942:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856109184:0@lo:8: 00000004:00080000:3.0:1787430701.316551:0:8168:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787430701.316700:0:8168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164871372197ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787430701.318702:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856109952:0@lo:101: 00010000:00010000:1.0:1787430701.318735:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.318761:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430701.319179:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856110080:0@lo:501: 00000100:00100000:1.0:1787430701.319237:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430701.319283:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110080 00000100:00100000:1.0:1787430701.319289:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110080 00000100:00100000:1.0:1787430701.319366:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787430701.319375:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856110080:12345-0@lo:501: 00000100:00100000:1.0:1787430701.319566:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856110080:12345-0@lo:501: Request processed in 190us (327us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430701.319574:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787430701.319626:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430701.319642:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feeded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856110080:0@lo:501: 10000000:01000000:1.0:1787430701.319665:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787430701.319673:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.319683:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430701.341448:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430701.341472:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856110208:0@lo:13: 00000100:00100000:3.0:1787430701.341538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.342027:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110208 00000100:00100000:3.0:1787430701.342036:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110208 00000100:00100000:3.0:1787430701.342207:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430701.342217:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856110208:12345-0@lo:13: 00002000:00000024:3.0:1787430701.342250:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787430701.342297:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856110208:12345-0@lo:13: Request processed in 81us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430701.342304:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787430701.342358:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec22d880 x1874256856110208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430701.342376:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856110208:0@lo:13: 00000004:00080000:3.0:1787430701.342395:0:8170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787430701.342420:0:8170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110336:0@lo:7: 00000100:00100000:3.0:1787430701.342445:0:8170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.342468:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110336 00000100:00100000:3.0:1787430701.342471:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110336 00000100:00100000:3.0:1787430701.342496:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430701.342502:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8170:x1874256856110336:12345-0@lo:7: 00000100:00100000:2.0:1787430701.346400:0:8170:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28900 going to sleep for 11 seconds 00000100:00080000:1.0:1787430701.346466:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1787430701.348534:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787430701.348541:0:6686:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787430701.348700:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8170:x1874256856110336:12345-0@lo:7: Request processed in 6192us (6248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430701.348711:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787430701.348775:0:8170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec22d880 x1874256856110336/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787430717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430701.348792:0:8170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110336:0@lo:7: 00000004:00080000:0.0:1787430701.348806:0:8170:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787430701.348850:0:8170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110464:0@lo:5: 00000100:00100000:0.0:1787430701.348883:0:8170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430701.349000:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110464 00000100:00100000:3.0:1787430701.349007:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110464 00000100:00100000:3.0:1787430701.349054:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430701.349062:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8170:x1874256856110464:12345-0@lo:5: 00002000:00080000:3.0:1787430701.349085:0:6685:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787430701.349088:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787430701.349273:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8170:x1874256856110464:12345-0@lo:5: Request processed in 210us (388us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787430701.349279:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430701.349321:0:8170:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00010000:00080000:0.0:1787430701.349357:0:8170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73ce300 x1874256856110464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430701.349368:0:8170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110464:0@lo:5: 00000004:00080000:0.0:1787430701.349377:0:8170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787430701.349400:0:8170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110592:0@lo:700: 00000100:00100000:0.0:1787430701.349465:0:8170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.349493:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110592 00000100:00100000:0.0:1787430701.349496:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110592 00000100:00100000:0.0:1787430701.349520:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430701.349526:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8170:x1874256856110592:12345-0@lo:700: 00000100:00100000:0.0:1787430701.349573:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1874256856110720:0@lo:700: 00000100:00100000:0.0:1787430701.349727:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430701.349787:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430701.349803:0:8170:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430701.350242:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110720 00000100:00100000:2.0:1787430701.350247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110720 00000100:00100000:2.0:1787430701.350283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430701.350291:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1874256856110720:12345-0@lo:700: 00000004:00080000:2.0:1787430701.359613:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787430701.401696:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787430701.409668:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1874256856110720:12345-0@lo:700: Request processed in 59370us (59932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.409691:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787430701.409831:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe630000 x1874256856110720/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787430717 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430701.409848:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1874256856110720:0@lo:700: 40000000:02000000:2.0:1787430701.409867:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1787430701.472150:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787430701.472170:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787430701.472390:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8170:x1874256856110592:12345-0@lo:700: Request processed in 122856us (122917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.472408:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787430701.472726:0:8170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2f73cc380 x1874256856110592/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787430717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430701.472750:0:8170:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787430701.472774:0:8170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110592:0@lo:700: 00000004:02000040:2.0:1787430701.502054:0:8170:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787430701.512874:0:8170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110848:0@lo:5: 00000100:00100000:2.0:1787430701.513091:0:8170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430701.513164:0:8170:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430701.513262:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110848 00000100:00100000:3.0:1787430701.513272:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110848 00000100:00100000:3.0:1787430701.513437:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430701.513459:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8170:x1874256856110848:12345-0@lo:5: 00002000:00080000:3.0:1787430701.522533:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787430701.522559:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787430701.530027:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8170:x1874256856110848:12345-0@lo:5: Request processed in 16563us (16929us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787430701.530051:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787430701.531869:0:8170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c9397800 x1874256856110848/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787430717 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430701.531902:0:8170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8170:1874256856110848:0@lo:5: 00000004:00080000:2.0:1787430701.531925:0:8170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:3.0:1787430701.598812:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1787430701.929402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430701.929590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841408640 00000100:00100000:0.0:1787430701.929606:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841408640 00000100:00100000:0.0:1787430701.929661:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:0.0:1787430701.929671:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2370:x1874256841408640:12345-192.168.204.60@tcp:250: 00010000:00080000:0.0:1787430701.929699:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d1f5d489-c087-4ebd-841c-a9b0d4541e2c@192.168.204.60@tcp t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1787430701.929725:0:5830:0:(genops.c:1385:class_connect()) connect: client d1f5d489-c087-4ebd-841c-a9b0d4541e2c, cookie 0x1fa5b1e070e68d0e 00000100:00080000:0.0:1787430701.930035:0:5830:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430701.930107:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+5:2370:x1874256841408640:12345-192.168.204.60@tcp:250: Request processed in 434us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.930116:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:0.0:1787430701.938018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430701.938078:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841408768 00000100:00100000:1.0:1787430701.938096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841408768 00000100:00100000:1.0:1787430701.938179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 110 00000100:00100000:1.0:1787430701.938192:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+5:5593:x1874256841408768:12345-192.168.204.60@tcp:101: 00010000:00010000:1.0:1787430701.938799:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430701.938824:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14434 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.938863:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.938875:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.938886:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302044400, rc 0) 00000100:00100000:1.0:1787430701.938989:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+6:5593:x1874256841408768:12345-192.168.204.60@tcp:101: Request processed in 797us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.938998:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 110 00000100:00100000:3.0:1787430701.943639:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430701.944036:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841408896 00000100:00100000:0.0:1787430701.944047:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841408896 00000100:00100000:0.0:1787430701.944110:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 111 00000100:00100000:0.0:1787430701.944122:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+6:5593:x1874256841408896:12345-192.168.204.60@tcp:501: 00000100:00100000:0.0:1787430701.944922:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+6:5593:x1874256841408896:12345-192.168.204.60@tcp:501: Request processed in 800us (1291us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430701.944932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 111 00000100:00100000:0.0:1787430701.951899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430701.951976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409024 00000100:00100000:1.0:1787430701.951994:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409024 00000100:00100000:1.0:1787430701.952071:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 112 00000100:00100000:1.0:1787430701.952083:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+6:5593:x1874256841409024:12345-192.168.204.60@tcp:101: 00010000:00010000:1.0:1787430701.952107:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430701.952132:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1443b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.952167:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.952179:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.952191:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302045000, rc 0) 00000100:00100000:1.0:1787430701.952300:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+7:5593:x1874256841409024:12345-192.168.204.60@tcp:101: Request processed in 219us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.952306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 112 00000100:00100000:2.0:1787430701.958977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430701.959366:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409152 00000100:00100000:0.0:1787430701.959380:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409152 00000100:00100000:0.0:1787430701.959448:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:0.0:1787430701.959461:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+7:5593:x1874256841409152:12345-192.168.204.60@tcp:501: 00000100:00100000:0.0:1787430701.959840:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5593:x1874256841409152:12345-192.168.204.60@tcp:501: Request processed in 380us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430701.959850:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:0.0:1787430701.964612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430701.964707:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409280 00000100:00100000:1.0:1787430701.964724:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409280 00000100:00100000:1.0:1787430701.964820:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:1.0:1787430701.964834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5593:x1874256841409280:12345-192.168.204.60@tcp:503: 00000100:00100000:1.0:1787430701.965415:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5593:x1874256841409280:12345-192.168.204.60@tcp:503: Request processed in 582us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.965425:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:2.0:1787430701.970428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430701.970477:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409408 00000100:00100000:2.0:1787430701.970490:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409408 00000100:00100000:2.0:1787430701.970554:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 115 00000100:00100000:2.0:1787430701.970567:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5612:x1874256841409408:12345-192.168.204.60@tcp:502: 00000100:00100000:2.0:1787430701.971117:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5612:x1874256841409408:12345-192.168.204.60@tcp:502: Request processed in 550us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430701.971128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 115 00000100:00100000:0.0:1787430701.984740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430701.984824:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409536 00000100:00100000:1.0:1787430701.984836:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409536 00000100:00100000:1.0:1787430701.984899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 116 00000100:00100000:1.0:1787430701.984910:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5612:x1874256841409536:12345-192.168.204.60@tcp:502: 00000100:00100000:1.0:1787430701.985224:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5612:x1874256841409536:12345-192.168.204.60@tcp:502: Request processed in 314us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.985234:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 116 00000100:00100000:0.0:1787430701.989555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430701.989928:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409664 00000100:00100000:1.0:1787430701.989948:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409664 00000100:00100000:1.0:1787430701.990184:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 117 00000100:00100000:1.0:1787430701.990196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:5593:x1874256841409664:12345-192.168.204.60@tcp:101: 00010000:00010000:1.0:1787430701.990279:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430701.990300:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302044600/0x1fa5b1e070e68d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14465 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.990364:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302044600/0x1fa5b1e070e68d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14465 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.990398:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302044600/0x1fa5b1e070e68d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14465 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430701.990408:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302044600, rc 0) 00000100:00100000:1.0:1787430701.990538:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5593:x1874256841409664:12345-192.168.204.60@tcp:101: Request processed in 344us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.990547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 117 00000100:00100000:3.0:1787430701.994044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430701.994082:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409792 00000100:00100000:0.0:1787430701.994095:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409792 00000100:00100000:0.0:1787430701.994289:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 118 00000100:00100000:0.0:1787430701.994304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5593:x1874256841409792:12345-192.168.204.60@tcp:256: 20000000:01000000:0.0:1787430701.994368:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787430701.994393:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787430701.994398:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787430701.994401:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787430701.994404:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787430701.996265:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5593:x1874256841409792:12345-192.168.204.60@tcp:256: Request processed in 1952us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430701.996280:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 118 00000100:00100000:0.0:1787430702.000208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430702.000258:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841409920 00000100:00100000:1.0:1787430702.000271:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841409920 00000100:00100000:1.0:1787430702.000376:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:1.0:1787430702.000391:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5593:x1874256841409920:12345-192.168.204.60@tcp:101: 00010000:00010000:1.0:1787430702.000414:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430702.000439:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1446c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.000480:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.000492:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430702.000501:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f302045600, rc 0) 00000100:00100000:1.0:1787430702.000568:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5593:x1874256841409920:12345-192.168.204.60@tcp:101: Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.000585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:1.0:1787430702.002839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430702.002886:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410048 00000100:00100000:1.0:1787430702.002897:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410048 00000100:00100000:1.0:1787430702.002952:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 120 00000100:00100000:1.0:1787430702.003023:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5593:x1874256841410048:12345-192.168.204.60@tcp:501: 00000100:00100000:1.0:1787430702.003322:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5593:x1874256841410048:12345-192.168.204.60@tcp:501: Request processed in 357us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.003360:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 120 00000100:00100000:2.0:1787430702.006166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430702.006308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410176 00000100:00100000:0.0:1787430702.006321:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410176 00000100:00100000:0.0:1787430702.006405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 121 00000100:00100000:0.0:1787430702.006433:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5593:x1874256841410176:12345-192.168.204.60@tcp:503: 00000100:00100000:0.0:1787430702.006917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5593:x1874256841410176:12345-192.168.204.60@tcp:503: Request processed in 483us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430702.006928:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 121 00000100:00100000:0.0:1787430702.009998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430702.010273:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410304 00000100:00100000:1.0:1787430702.010287:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410304 00000100:00100000:1.0:1787430702.010437:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00100000:1.0:1787430702.010662:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5616:x1874256841410304:12345-192.168.204.60@tcp:502: 00000100:00100000:1.0:1787430702.011033:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5616:x1874256841410304:12345-192.168.204.60@tcp:502: Request processed in 583us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430702.011042:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00100000:1.0:1787430702.015926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430702.016034:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410432 00000100:00100000:3.0:1787430702.016049:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410432 00000100:00100000:3.0:1787430702.016107:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:3.0:1787430702.016121:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5616:x1874256841410432:12345-192.168.204.60@tcp:502: 00000100:00100000:3.0:1787430702.016413:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5616:x1874256841410432:12345-192.168.204.60@tcp:502: Request processed in 295us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430702.016423:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:2.0:1787430702.022002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430702.022043:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410560 00000100:00100000:2.0:1787430702.022053:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410560 00000100:00100000:2.0:1787430702.022097:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:2.0:1787430702.022106:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2370:x1874256841410560:12345-192.168.204.60@tcp:38: 00010000:00080000:2.0:1787430702.022135:0:6884:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1787430702.022186:0:6884:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e68d31 00000004:00100000:2.0:1787430702.022215:0:6884:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787430702.022222:0:6884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787430702.071546:0:6884:0:(import.c:65:import_set_state_nolock()) ffffa0f2ef2f0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430702.071664:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841410560:12345-192.168.204.60@tcp:38: Request processed in 49555us (49667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430702.071678:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00010000:00010000:3.0:1787430702.109561:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430703.078379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430703.078426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430703.078520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410816 00000100:00100000:0.0:1787430703.078520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410688 00000100:00100000:2.0:1787430703.078530:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410816 00000100:00100000:0.0:1787430703.078531:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410688 00000100:00100000:2.0:1787430703.078602:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787430703.078673:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feeddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:5593:x1874256841410816:12345-192.168.204.60@tcp:41: 00000004:00000024:2.0:1787430703.078729:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787430703.078805:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feeddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:5593:x1874256841410816:12345-192.168.204.60@tcp:41: Request processed in 193us (377us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430703.079649:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430703.079940:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787430703.079966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787430703.079975:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feeded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:0:x1874256841410688:12345-192.168.204.60@tcp:41: 00000004:00000024:2.0:1787430703.079991:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787430703.080042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feeded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:0:x1874256841410688:12345-192.168.204.60@tcp:41: Request processed in 68us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.080049:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:1.0:1787430703.083779:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430703.084020:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841410944 00000100:00100000:3.0:1787430703.084029:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841410944 00000100:00100000:3.0:1787430703.084137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:3.0:1787430703.084148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5593:x1874256841410944:12345-192.168.204.60@tcp:40: 00000100:00100000:3.0:1787430703.084236:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5593:x1874256841410944:12345-192.168.204.60@tcp:40: Request processed in 90us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.084244:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:3.0:1787430703.087099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430703.087199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430703.087234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430703.087272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430703.087796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411328 00000100:00100000:2.0:1787430703.087806:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411328 00000100:00100000:1.0:1787430703.087808:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411456 00000100:00100000:1.0:1787430703.087814:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411456 00000100:00100000:1.0:1787430703.087855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 124 00000100:00100000:1.0:1787430703.087865:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2374:x1874256841411456:12345-192.168.204.60@tcp:400: 00000100:00100000:0.0:1787430703.087898:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411072 00000100:00100000:0.0:1787430703.087903:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411072 00000100:00100000:2.0:1787430703.087912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:2.0:1787430703.087925:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5593:x1874256841411328:12345-192.168.204.60@tcp:33: 00000100:00100000:0.0:1787430703.087928:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411200 00000100:00100000:0.0:1787430703.087932:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411200 00000100:00100000:3.0:1787430703.087936:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:1.0:1787430703.087937:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2374:x1874256841411456:12345-192.168.204.60@tcp:400: Request processed in 69us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.087943:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1874256841411072:12345-192.168.204.60@tcp:8: 00000100:00100000:1.0:1787430703.087964:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 124 00010000:00080000:3.0:1787430703.087978:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1787430703.088011:0:6683:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e68d38 00002000:00100000:3.0:1787430703.088024:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 711a801a-27eb-4d09-8ae0-8dc5ece71a10/ffffa0f2c562a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787430703.088047:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787430703.088376:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787430703.088402:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430703.089104:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841411072:12345-192.168.204.60@tcp:8: Request processed in 1158us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.089114:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787430703.089134:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787430703.089140:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1874256841411200:12345-192.168.204.60@tcp:8: 00010000:00080000:3.0:1787430703.089159:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1787430703.089182:0:6683:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e68d3f 00002000:00100000:3.0:1787430703.089189:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 711a801a-27eb-4d09-8ae0-8dc5ece71a10/ffffa0f2c346c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787430703.089196:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787430703.089460:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787430703.089478:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3468000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430703.089508:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841411200:12345-192.168.204.60@tcp:8: Request processed in 368us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430703.089515:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000004:00080000:1.0:1787430703.098947:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10960us 00000004:00200000:1.0:1787430703.107084:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787430703.107279:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5593:x1874256841411328:12345-192.168.204.60@tcp:33: Request processed in 19352us (20183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430703.107293:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00010000:00010000:1.0:1787430703.133268:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430703.263913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430703.264050:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411584 00000100:00100000:2.0:1787430703.264073:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411584 00000100:00100000:2.0:1787430703.264127:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430703.264136:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5633:x1874256841411584:12345-192.168.204.60@tcp:101: 00010000:00010000:2.0:1787430703.264155:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430703.264228:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14496 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.264303:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e68d4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.264316:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e68d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.264356:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e68d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430703.264760:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787430703.264765:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430703.264834:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e68d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.264860:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14496 expref: 8 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.264875:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e68d4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14496 expref: 7 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430703.264884:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430703.265047:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430703.265051:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74400, rc 0) 00000100:00100000:2.0:1787430703.265119:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:5633:x1874256841411584:12345-192.168.204.60@tcp:101: Request processed in 983us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430703.265126:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00010000:00010000:3.0:1787430704.156528:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430704.928457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430704.928598:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411712 00000100:00100000:2.0:1787430704.928607:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411712 00000100:00100000:2.0:1787430704.928669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430704.928693:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:5685:x1874256841411712:12345-192.168.204.60@tcp:41: 00000004:00000024:2.0:1787430704.928739:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787430704.928813:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:5685:x1874256841411712:12345-192.168.204.60@tcp:41: Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430704.928821:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:1.0:1787430704.931624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430704.931755:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411840 00000100:00100000:3.0:1787430704.931767:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411840 00000100:00100000:3.0:1787430704.931842:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:3.0:1787430704.931866:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5685:x1874256841411840:12345-192.168.204.60@tcp:13: 00002000:00000024:3.0:1787430704.931921:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430704.932000:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5685:x1874256841411840:12345-192.168.204.60@tcp:13: Request processed in 148us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430704.932007:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00080000:1.0:1787430704.932309:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430704.936950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430704.937082:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841411968 00000100:00100000:2.0:1787430704.937092:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841411968 00000100:00100000:2.0:1787430704.937167:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787430704.937180:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5685:x1874256841411968:12345-192.168.204.60@tcp:13: 00000100:00080000:1.0:1787430704.937291:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787430704.937398:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430704.937506:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:5685:x1874256841411968:12345-192.168.204.60@tcp:13: Request processed in 328us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430704.937514:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00010000:00010000:2.0:1787430705.181727:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430705.373573:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856110976:0@lo:13: 00000100:00100000:3.0:1787430705.373650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430705.373709:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856110976 00000100:00100000:0.0:1787430705.373718:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856110976 00000100:00080000:3.0:1787430705.373751:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430705.373781:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430705.373792:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856110976:12345-0@lo:13: 00002000:00000024:0.0:1787430705.373813:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430705.373988:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856110976:12345-0@lo:13: Request processed in 196us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430705.373996:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787430705.374020:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe630700 x1874256856110976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430705.374040:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856110976:0@lo:13: 00010000:00010000:2.0:1787430706.207369:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430706.397035:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856111104:0@lo:400: 00000100:00100000:3.0:1787430706.397106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430706.397826:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856111360:0@lo:13: 00000100:00100000:2.0:1787430706.397869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430706.397920:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856111360 00000100:00100000:2.0:1787430706.397929:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856111360 00000100:00100000:2.0:1787430706.397986:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430706.398119:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856111360:12345-0@lo:13: 00002000:00000024:2.0:1787430706.398151:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430706.398199:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856111360:12345-0@lo:13: Request processed in 84us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430706.398207:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787430706.398230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787430706.398260:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c9394380 x1874256856111360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430706.398271:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787430706.398291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856111360:0@lo:13: 00000100:00100000:2.0:1787430706.398350:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856111104 00000100:00100000:2.0:1787430706.398355:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856111104 00000100:00100000:2.0:1787430706.398383:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430706.398391:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856111104:12345-0@lo:400: 00000100:00100000:2.0:1787430706.399162:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856111104:12345-0@lo:400: Request processed in 769us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430706.399170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787430706.399190:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856111232:0@lo:400: 00000100:00100000:0.0:1787430706.399230:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430706.399279:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856111232 00000100:00100000:0.0:1787430706.399284:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856111232 00000100:00100000:0.0:1787430706.399321:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430706.399349:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856111232:12345-0@lo:400: 00000100:00100000:0.0:1787430706.399396:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856111232:12345-0@lo:400: Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430706.399410:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430706.399447:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856111232:0@lo:400: 00000100:00100000:2.0:1787430706.400568:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430706.400593:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856111488:0@lo:400: 00000100:00100000:2.0:1787430706.400692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430706.400745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856111488 00000100:00100000:2.0:1787430706.400753:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856111488 00000100:00100000:0.0:1787430706.400784:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856111744:0@lo:400: 00000100:00100000:2.0:1787430706.400801:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430706.400811:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856111488:12345-0@lo:400: 00000100:00100000:0.0:1787430706.400819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430706.400858:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856111488:12345-0@lo:400: Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430706.400865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430706.401068:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856111744 00000100:00100000:2.0:1787430706.401073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856111744 00000100:00100000:2.0:1787430706.401101:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430706.401107:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856111744:12345-0@lo:400: 00000100:00100000:2.0:1787430706.401141:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856111744:12345-0@lo:400: Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430706.401148:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787430706.401171:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430706.401199:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856111488:0@lo:400: 00000100:00100000:0.0:1787430706.401654:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856111744:0@lo:400: 00000100:00100000:0.0:1787430706.401671:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430706.401678:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856111616:0@lo:400: 00000100:00100000:0.0:1787430706.401707:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430706.401981:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856111616 00000100:00100000:0.0:1787430706.401986:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856111616 00000100:00100000:0.0:1787430706.402020:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430706.402027:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856111616:12345-0@lo:400: 00000100:00100000:0.0:1787430706.402066:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856111616:12345-0@lo:400: Request processed in 39us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430706.402072:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787430706.402373:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c9397800 x1874256856111616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430706.402387:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856111616:0@lo:400: 00000100:00100000:3.0:1787430706.403664:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856111104:0@lo:400: 00000001:00100000:2.0:1787430706.462225:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000001:02000400:2.0:1787430706.509683:0:8296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787430707.231558:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787430707.448086:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000001:00100000:3.0:1787430707.455411:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000100:00100000:0.0:1787430708.250058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430708.250176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430708.250204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430708.250252:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412480 00000100:00100000:3.0:1787430708.250268:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412480 00000100:00100000:1.0:1787430708.250290:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412352 00000100:00100000:1.0:1787430708.250297:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412352 00000100:00100000:3.0:1787430708.250456:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:3.0:1787430708.250473:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841412352:12345-192.168.204.60@tcp:400: 00000100:00100000:2.0:1787430708.250497:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412224 00000100:00100000:2.0:1787430708.250503:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412224 00000100:00100000:2.0:1787430708.250546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:2.0:1787430708.250557:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2371:x1874256841412224:12345-192.168.204.60@tcp:400: 00000100:00100000:3.0:1787430708.250591:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841412352:12345-192.168.204.60@tcp:400: Request processed in 121us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.250599:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2371:x1874256841412224:12345-192.168.204.60@tcp:400: Request processed in 42us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.250620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:0.0:1787430708.250703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.250876:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:1.0:1787430708.250889:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841412480:12345-192.168.204.60@tcp:400: 00000100:00100000:3.0:1787430708.250896:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:1.0:1787430708.250926:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841412480:12345-192.168.204.60@tcp:400: Request processed in 41us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.250934:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00080000:0.0:1787430708.250946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430708.250951:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430708.250954:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430708.250958:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412096 00000100:00100000:1.0:1787430708.250962:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412096 00000100:00100000:1.0:1787430708.251003:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 126 00000100:00100000:1.0:1787430708.251010:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2372:x1874256841412096:12345-192.168.204.60@tcp:400: 00000100:00100000:1.0:1787430708.251039:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2372:x1874256841412096:12345-192.168.204.60@tcp:400: Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.251046:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 126 00010000:00010000:2.0:1787430708.252748:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787430708.698670:0:8448:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6a3b72e0 20000000:00000080:1.0:1787430708.698691:0:8448:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f1c4ca7c00 uarg=0000000000000000 20000000:01000000:1.0:1787430708.698726:0:8448:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787430708.698728:0:8448:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787430708.698731:0:8448:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787430708.698735:0:8448:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787430708.698740:0:8448:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787430708.698753:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787430708.698755:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787430708.699024:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787430708.699028:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787430708.699860:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787430708.700276:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787430708.700546:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787430708.700591:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787430708.700617:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787430708.700619:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787430708.701234:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787430708.701579:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787430708.701639:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787430708.701692:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787430708.701707:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787430708.701709:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787430708.702566:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787430708.702949:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787430708.702993:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787430708.703031:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787430708.703044:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787430708.703046:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787430708.703762:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787430708.704064:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787430708.704130:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787430708.704170:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787430708.704184:0:8448:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787430708.704202:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704220:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704229:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704236:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704242:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704247:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704253:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704258:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704266:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704272:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704289:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704432:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704447:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 9 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.704463:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856111872:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430708.704590:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704609:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 9 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.704618:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112000:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430708.704651:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704659:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 18 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.704668:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112128:0@lo:104: 00000100:00100000:2.0:1787430708.704708:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430708.704746:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704762:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 18 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.704770:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112256:0@lo:104: 00000100:00100000:2.0:1787430708.704793:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430708.704829:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704838:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 18 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.704846:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112384:0@lo:104: 00010000:00010000:2.0:1787430708.704872:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704880:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 18 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.704887:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787430708.704889:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112512:0@lo:104: 00000100:00100000:3.0:1787430708.704912:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430708.704938:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112128 00000100:00100000:2.0:1787430708.704943:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430708.704947:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112128 00010000:00010000:2.0:1787430708.704968:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.704979:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 18 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.704985:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112256 00000100:00100000:3.0:1787430708.704989:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112256 00000100:00100000:2.0:1787430708.704989:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9395f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112640:0@lo:104: 00000100:00100000:3.0:1787430708.705000:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112384 00000100:00100000:3.0:1787430708.705009:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112384 00000100:00100000:2.0:1787430708.705015:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430708.705019:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112512 00000100:00100000:3.0:1787430708.705022:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112512 00000100:00100000:3.0:1787430708.705035:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112640 00000100:00100000:3.0:1787430708.705037:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112640 00000100:00100000:3.0:1787430708.705049:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430708.705058:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+7:8448:x1874256856112128:12345-0@lo:104: 00010000:00010000:2.0:1787430708.705062:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.705071:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.705073:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 18 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.705095:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112768:0@lo:104: 00000100:00100000:2.0:1787430708.705124:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430708.705144:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.705151:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 18 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.705159:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112896:0@lo:104: 00000100:00100000:2.0:1787430708.705178:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430708.705188:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fde636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430708.705238:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787430708.705245:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787430708.705461:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112768 00000100:00100000:2.0:1787430708.705465:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112768 00000100:00100000:2.0:1787430708.705488:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787430708.705495:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856112896 00000100:00100000:2.0:1787430708.705497:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856112896 00000100:00100000:0.0:1787430708.705592:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430708.705612:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe918050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:8448:x1874256856112256:12345-0@lo:104: 00010000:00010000:0.0:1787430708.705621:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705679:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430708.705685:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe918050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:8448:x1874256856112256:12345-0@lo:104: Request processed in 87us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.705693:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787430708.705711:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430708.705717:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705725:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0031400 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430708.705728:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705737:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430708.705744:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430708.705750:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430708.705780:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705787:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430708.705813:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705820:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031400/0x1fa5b1e070e68cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cdd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705831:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430708.705833:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430708.705835:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430708.705848:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856113024:0@lo:103: 00000100:00100000:0.0:1787430708.705878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.705912:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113024 00000100:00100000:0.0:1787430708.705916:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113024 00010000:00010000:0.0:1787430708.705935:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 19 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430708.705957:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430708.705964:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856113024:12345-0@lo:103: 00010000:00010000:0.0:1787430708.705973:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430708.705978:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 19 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.705987:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 19 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706002:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430708.706029:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856113024:12345-0@lo:103: Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.706035:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430708.706070:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856113024:0@lo:103: 00000100:00100000:0.0:1787430708.706100:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430708.706107:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+8:8448:x1874256856112384:12345-0@lo:104: 00010000:00010000:0.0:1787430708.706115:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706148:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430708.706153:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+8:8448:x1874256856112384:12345-0@lo:104: Request processed in 47us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.706160:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787430708.706173:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430708.706177:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706184:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f302044e00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430708.706187:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706194:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430708.706201:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430708.706206:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430708.706221:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706227:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430708.706238:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706251:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f302044e00/0x1fa5b1e070e68cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706262:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430708.706264:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430708.706265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430708.706275:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856113152:0@lo:103: 00000100:00100000:0.0:1787430708.706298:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.706354:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113152 00000100:00100000:0.0:1787430708.706359:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113152 00010000:00010000:3.0:1787430708.706364:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430708.706373:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+7:8448:x1874256856112128:12345-0@lo:104: Request processed in 1316us (1664us total) trans 0 rc 0/0 00010000:00010000:0.0:1787430708.706378:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 19 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.706384:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430708.706409:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430708.706417:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856113152:12345-0@lo:103: 00000100:00100000:3.0:1787430708.706426:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787430708.706427:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430708.706434:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 19 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.706442:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:8448:x1874256856112512:12345-0@lo:104: 00010000:00010000:0.0:1787430708.706448:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 19 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706460:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430708.706488:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856113152:12345-0@lo:103: Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.706494:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787430708.706510:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430708.706519:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856113152:0@lo:103: 00000100:00100000:0.0:1787430708.706553:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787430708.706554:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787430708.706562:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:8448:x1874256856112512:12345-0@lo:104: Request processed in 127us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.706565:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+6:8448:x1874256856112640:12345-0@lo:104: 00000100:00100000:3.0:1787430708.706574:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787430708.706577:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.706621:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787430708.706626:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:8448:x1874256856112640:12345-0@lo:104: Request processed in 66us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.706686:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112128:0@lo:104: 00010000:00010000:2.0:1787430708.706693:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e68cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68cd6 expref: 18 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.706703:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112256:0@lo:104: 00000100:00100000:3.0:1787430708.706705:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787430708.706711:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e68cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68cba expref: 17 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.706719:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:8448:x1874256856112768:12345-0@lo:104: 00000100:00100000:2.0:1787430708.706721:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112384:0@lo:104: 00010000:00010000:3.0:1787430708.706738:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.706745:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112512:0@lo:104: 00000100:00100000:2.0:1787430708.706756:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9395f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112640:0@lo:104: 00010000:00010000:3.0:1787430708.706783:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787430708.706791:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112768:0@lo:104: 00000100:00100000:3.0:1787430708.706792:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:8448:x1874256856112768:12345-0@lo:104: Request processed in 75us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.707199:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787430708.707216:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430708.707223:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:8448:x1874256856112896:12345-0@lo:104: 00010000:00010000:0.0:1787430708.707232:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430708.707315:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787430708.707321:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:8448:x1874256856112896:12345-0@lo:104: Request processed in 100us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430708.707356:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430708.707529:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112896:0@lo:104: 00000100:00100000:3.0:1787430708.707665:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787430708.707685:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787430708.707689:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.707697:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f302044a00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430708.707701:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.707708:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430708.707715:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430708.707721:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430708.707756:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.707762:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787430708.707816:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856113280:0@lo:103: 00000100:00100000:0.0:1787430708.707850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430708.707934:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113280 00000100:00100000:2.0:1787430708.707940:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113280 00010000:00010000:2.0:1787430708.707960:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 17 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.707991:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430708.707999:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:3309:x1874256856113280:12345-0@lo:103: 00010000:00010000:2.0:1787430708.708008:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430708.708014:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 17 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.708023:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 17 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.708035:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68d00 expref: 17 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.708045:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430708.708198:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708206:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f302044a00/0x1fa5b1e070e68d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68d07 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708227:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787430708.708231:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708237:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0030000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430708.708240:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708247:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430708.708253:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430708.708271:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430708.708292:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708298:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787430708.708575:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3309:x1874256856113280:12345-0@lo:103: Request processed in 576us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.708582:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430708.708641:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856113280:0@lo:103: 00000100:00100000:0.0:1787430708.708654:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430708.708661:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856113408:0@lo:103: 00000100:00100000:0.0:1787430708.708687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430708.708726:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113408 00000100:00100000:1.0:1787430708.708732:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113408 00010000:00010000:1.0:1787430708.708751:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 16 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708807:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708815:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708827:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787430708.708827:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787430708.708833:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430708.708840:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe632680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3309:x1874256856113408:12345-0@lo:103: 00010000:00010000:1.0:1787430708.708851:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430708.708854:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0030800 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:1.0:1787430708.708859:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 16 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430708.708860:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708878:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430708.708895:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.708901:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 16 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430708.708905:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430708.708920:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302044000/0x1fa5b1e070e68cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68cac expref: 16 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.708926:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.708931:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430708.708936:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787430708.708968:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe632680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:3309:x1874256856113408:12345-0@lo:103: Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.708975:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430708.708981:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856113536:0@lo:103: 00000100:00100000:0.0:1787430708.709017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430708.709042:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856113408:0@lo:103: 00010000:00010000:3.0:1787430708.709075:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.709079:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113536 00000100:00100000:2.0:1787430708.709085:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113536 00010000:00010000:3.0:1787430708.709086:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ca5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709099:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430708.709102:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 15 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709104:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709118:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0031200 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430708.709123:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.709147:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787430708.709148:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430708.709158:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.709158:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:3307:x1874256856113536:12345-0@lo:103: 10000000:01000000:3.0:1787430708.709168:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430708.709169:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430708.709177:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 15 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.709188:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 15 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709189:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709206:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430708.709211:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68c9e expref: 15 pid: 5831 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430708.709232:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430708.709240:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856113664:0@lo:103: 00010000:00010000:2.0:1787430708.709257:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430708.709286:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3307:x1874256856113536:12345-0@lo:103: Request processed in 130us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.709292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787430708.709440:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787430708.709462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430708.709498:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856113536:0@lo:103: 00000100:00100000:1.0:1787430708.709542:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113664 00000100:00100000:1.0:1787430708.709548:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113664 00010000:00010000:3.0:1787430708.709560:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.709563:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709580:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031200/0x1fa5b1e070e68c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c7b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.709595:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430708.709608:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430708.709611:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430708.709611:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787430708.709622:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3307:x1874256856113664:12345-0@lo:103: 00010000:00010000:1.0:1787430708.709631:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430708.709636:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.709644:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.709654:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a400/0x1fa5b1e070e68c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68c74 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.709673:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430708.709715:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3307:x1874256856113664:12345-0@lo:103: Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.709721:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787430708.709780:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856113664:0@lo:103: 00010000:00010000:0.0:1787430708.709829:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430708.709868:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430708.709870:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430708.710079:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.710087:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0031000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430708.710090:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.710098:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430708.710114:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430708.710119:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787430708.710147:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.710153:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430708.710179:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.710186:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c51 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.710199:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430708.710201:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430708.710203:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430708.710289:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856113792:0@lo:103: 00000100:00100000:0.0:1787430708.710475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430708.710752:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856113792 00000100:00100000:2.0:1787430708.710758:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856113792 00010000:00010000:2.0:1787430708.710775:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.710799:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430708.710806:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3309:x1874256856113792:12345-0@lo:103: 00010000:00010000:2.0:1787430708.710815:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430708.710820:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.710829:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.710848:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302045400/0x1fa5b1e070e68c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68c4a expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430708.710859:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430708.710897:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:3309:x1874256856113792:12345-0@lo:103: Request processed in 92us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.710904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430708.710930:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856113792:0@lo:103: 00000100:00100000:0.0:1787430708.711778:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430708.711810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.711872:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856111872:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430708.711890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412608 00000100:00100000:1.0:1787430708.711895:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412608 00010000:00010000:1.0:1787430708.711915:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 10 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.711967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412736 00000100:00100000:3.0:1787430708.711972:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412736 00000100:00100000:3.0:1787430708.712010:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:1.0:1787430708.712020:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:3.0:1787430708.712022:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:5607:x1874256841412736:12345-192.168.204.60@tcp:101: 00000100:00100000:1.0:1787430708.712035:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:2373:x1874256841412608:12345-192.168.204.60@tcp:103: 00010000:00010000:3.0:1787430708.712040:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430708.712047:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430708.712055:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 11 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.712058:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1449d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712073:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 11 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.712085:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430708.712199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787430708.712502:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1449d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712529:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302045000/0x1fa5b1e070e68d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1443b expref: 12 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.712530:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712555:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430708.712559:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1449d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430708.712569:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a200, rc 0) 00000100:00100000:0.0:1787430708.712644:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787430708.712653:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787430708.712802:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:2373:x1874256841412608:12345-192.168.204.60@tcp:103: Request processed in 771us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.712811:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:1.0:1787430708.712829:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412864 00000100:00100000:1.0:1787430708.712840:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412864 00010000:00010000:1.0:1787430708.712857:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 11 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430708.712886:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:1.0:1787430708.712894:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:2374:x1874256841412864:12345-192.168.204.60@tcp:103: 00010000:00010000:1.0:1787430708.712903:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430708.712908:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 11 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712917:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 11 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712929:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712938:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712961:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712969:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712975:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.712982:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430708.712990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:5607:x1874256841412736:12345-192.168.204.60@tcp:101: Request processed in 968us (1211us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430708.712992:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74800 already unused, calling callback (ffffffffc15a9230) 00000100:00100000:3.0:1787430708.713001:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 127 00010000:00010000:1.0:1787430708.713004:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.713014:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.713027:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1449d expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.713035:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1449d expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.713063:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1449d expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430708.713076:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5824:1874256856113920:192.168.204.60@tcp:105: 00000100:00100000:1.0:1787430708.713120:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09000 going to sleep for 11 seconds 00010000:00010000:1.0:1787430708.713250:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302044400/0x1fa5b1e070e68d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14434 expref: 10 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430708.713261:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874256856112000:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430708.713302:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.713350:0:8448:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.713357:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430708.720837:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.720907:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5824:1874256856113920:192.168.204.60@tcp:105: 00010000:00010000:1.0:1787430708.720943:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.720957:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68d54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.720970:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430708.721063:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:2374:x1874256841412864:12345-192.168.204.60@tcp:103: Request processed in 8168us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.721073:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:2.0:1787430708.721500:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841412992 00000100:00100000:2.0:1787430708.721507:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841412992 00000100:00100000:2.0:1787430708.721547:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:2.0:1787430708.721556:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5607:x1874256841412992:12345-192.168.204.60@tcp:501: 00000100:00100000:2.0:1787430708.721972:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5607:x1874256841412992:12345-192.168.204.60@tcp:501: Request processed in 417us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430708.721979:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:2.0:1787430708.726492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430708.726565:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413120 00000100:00100000:3.0:1787430708.726578:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413120 00000100:00100000:3.0:1787430708.726649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 129 00000100:00100000:3.0:1787430708.726661:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5607:x1874256841413120:12345-192.168.204.60@tcp:503: 00000100:00100000:3.0:1787430708.726889:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5607:x1874256841413120:12345-192.168.204.60@tcp:503: Request processed in 229us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430708.726897:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 129 00000100:00100000:0.0:1787430708.736113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.736183:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413248 00000100:00100000:1.0:1787430708.736194:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413248 00000100:00100000:1.0:1787430708.736251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 130 00000100:00100000:1.0:1787430708.736263:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:6065:x1874256841413248:12345-192.168.204.60@tcp:502: 00000100:00100000:1.0:1787430708.736569:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:6065:x1874256841413248:12345-192.168.204.60@tcp:502: Request processed in 308us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.736578:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 130 00000100:00100000:2.0:1787430708.739704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.739948:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413376 00000100:00100000:1.0:1787430708.739958:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413376 00000100:00100000:1.0:1787430708.740012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 131 00000100:00100000:1.0:1787430708.740024:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:6065:x1874256841413376:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430708.740290:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:6065:x1874256841413376:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 268us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.740298:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 131 00000100:00100000:3.0:1787430708.742912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.743136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413504 00000100:00100000:1.0:1787430708.743147:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413504 00000100:00100000:1.0:1787430708.743200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:1.0:1787430708.743221:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5607:x1874256841413504:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430708.743237:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430708.743254:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a5400/0x1fa5b1e070e68d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc144a4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.743282:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a5400/0x1fa5b1e070e68d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144a4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.743642:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a5400/0x1fa5b1e070e68d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144a4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430708.743653:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5400, rc 0) 00000100:00100000:1.0:1787430708.743714:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841413504:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 496us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430708.743722:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:0.0:1787430708.747996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430708.748144:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413632 00000100:00100000:1.0:1787430708.748154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413632 00000100:00100000:1.0:1787430708.748209:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:1.0:1787430708.748220:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841413632:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430708.748637:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841413632:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 417us (649us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430708.748645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 133 00010000:00010000:3.0:1787430709.276704:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787430709.306205:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7c49e720 20000000:00000080:2.0:1787430709.306224:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f2f7d22c00 uarg=0000000000000000 20000000:01000000:2.0:1787430709.306257:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787430709.306263:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787430709.306267:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787430709.307138:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787430709.307293:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787430709.316581:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787430709.316651:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787430709.316711:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787430709.317323:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787430709.317450:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317479:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317487:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317493:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317503:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317510:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317551:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.317566:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 9 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.317582:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114048:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430709.320152:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.320169:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 11 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.320183:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114176:0@lo:104: 00000100:00100000:1.0:1787430709.320310:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430709.320366:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.320376:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 11 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.320386:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114304:0@lo:104: 00000100:00100000:1.0:1787430709.320425:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430709.320450:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.320458:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.320466:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114432:0@lo:104: 00000100:00100000:1.0:1787430709.320484:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430709.320563:0:8453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787430709.320581:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430709.320614:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114176 00000100:00100000:0.0:1787430709.320621:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114176 00000100:00100000:0.0:1787430709.320659:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114304 00000100:00100000:0.0:1787430709.320662:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114304 00000100:00100000:0.0:1787430709.320671:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114432 00000100:00100000:0.0:1787430709.320673:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114432 00000100:00100000:0.0:1787430709.320686:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430709.320702:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:8503:x1874256856114176:12345-0@lo:104: 00010000:00010000:0.0:1787430709.320714:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.320774:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430709.320781:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:8503:x1874256856114176:12345-0@lo:104: Request processed in 81us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.320788:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430709.320806:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787430709.320812:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdf05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:8503:x1874256856114304:12345-0@lo:104: 00010000:00010000:0.0:1787430709.320819:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.320852:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787430709.320857:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdf05850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:8503:x1874256856114304:12345-0@lo:104: Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.320863:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787430709.320890:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430709.320896:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:8503:x1874256856114432:12345-0@lo:104: 00010000:00010000:0.0:1787430709.320903:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.320935:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787430709.320939:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:8503:x1874256856114432:12345-0@lo:104: Request processed in 44us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.320944:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787430709.320959:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787430709.320972:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.320978:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430709.320982:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.320990:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430709.320998:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430709.321003:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430709.321032:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321040:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430709.321055:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321075:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74000/0x1fa5b1e070e68c66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68c6d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321087:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430709.321091:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321097:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430709.321099:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321116:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430709.321122:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430709.321127:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430709.321141:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321146:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430709.321162:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321168:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68b9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68ba2 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321177:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430709.321179:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321184:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430709.321187:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321193:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430709.321199:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430709.321210:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430709.321222:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321228:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430709.321243:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321250:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e68b39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68b40 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321263:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430709.321265:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430709.321267:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430709.321283:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430709.321294:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856114560:0@lo:103: 00000100:00100000:0.0:1787430709.321321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430709.321366:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856114688:0@lo:103: 00000100:00100000:0.0:1787430709.321387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430709.321402:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430709.321406:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856114816:0@lo:103: 00000100:00100000:0.0:1787430709.321424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430709.321452:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114560 00000100:00100000:0.0:1787430709.321457:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114560 00010000:00010000:0.0:1787430709.321476:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 12 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430709.321501:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114688 00000100:00100000:0.0:1787430709.321509:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114688 00010000:00010000:0.0:1787430709.321523:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430709.321535:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114816 00000100:00100000:0.0:1787430709.321537:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114816 00010000:00010000:0.0:1787430709.321547:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430709.321557:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430709.321563:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3309:x1874256856114560:12345-0@lo:103: 00010000:00010000:0.0:1787430709.321573:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430709.321579:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 14 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321597:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 14 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321614:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430709.321641:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3309:x1874256856114560:12345-0@lo:103: Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.321647:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430709.321661:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430709.321667:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3307:x1874256856114688:12345-0@lo:103: 00010000:00010000:0.0:1787430709.321674:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430709.321677:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321684:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321703:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430709.321729:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:3307:x1874256856114688:12345-0@lo:103: Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.321736:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787430709.321748:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430709.321754:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:3307:x1874256856114816:12345-0@lo:103: 00010000:00010000:0.0:1787430709.321760:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430709.321764:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321770:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.321778:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430709.321796:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:3307:x1874256856114816:12345-0@lo:103: Request processed in 43us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.321802:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430709.321836:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856114560:0@lo:103: 00000100:00100000:0.0:1787430709.321859:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856114816:0@lo:103: 00000100:00100000:0.0:1787430709.321866:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856114688:0@lo:103: 00010000:00010000:1.0:1787430709.322104:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68c66 expref: 11 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.322115:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114176:0@lo:104: 00010000:00010000:1.0:1787430709.322124:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0030e00/0x1fa5b1e070e68ba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68b9b expref: 10 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.322132:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114304:0@lo:104: 00010000:00010000:1.0:1787430709.322140:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68b40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68b39 expref: 9 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.322147:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114432:0@lo:104: 00010000:00010000:2.0:1787430709.322400:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430709.322406:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430709.323011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430709.323066:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413760 00000100:00100000:0.0:1787430709.323072:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413760 00010000:00010000:0.0:1787430709.323096:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 10 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430709.323129:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:0.0:1787430709.323144:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2374:x1874256841413760:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430709.323155:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430709.323160:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 10 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323170:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 10 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323186:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323193:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323207:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323213:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323218:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323224:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323229:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430709.323244:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323253:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323270:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430709.323279:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430709.323350:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2374:x1874256841413760:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 183us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430709.323358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 24 00010000:00010000:1.0:1787430709.324034:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302045600/0x1fa5b1e070e68d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1446c expref: 9 pid: 5832 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430709.324049:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874256856114048:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430709.324076:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.324085:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.324090:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430709.324096:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68d69 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.044789:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787430710.044798:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f1c4de8800 from 39 10000000:01000000:0.0:1787430710.044803:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430710.044847:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.044859:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.044871:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.044895:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856114944:0@lo:101: 00000100:00100000:0.0:1787430710.045092:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.045140:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c92b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.045203:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856114944 00000100:00100000:1.0:1787430710.045282:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856114944 00000100:00100000:1.0:1787430710.045352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787430710.045361:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+9:5834:x1874256856114944:12345-0@lo:101: 00010000:00010000:1.0:1787430710.045374:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430710.045386:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a5800/0x1fa5b1e070e68d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68d70 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.045408:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a5800/0x1fa5b1e070e68d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d70 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.045418:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a5800/0x1fa5b1e070e68d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d70 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.045436:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5800, rc 0) 00000100:00100000:1.0:1787430710.045473:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856114944:12345-0@lo:101: Request processed in 114us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.045479:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787430710.045767:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856114944:0@lo:101: 00010000:00010000:0.0:1787430710.045783:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.045795:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.045869:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115072:0@lo:501: 00000100:00100000:0.0:1787430710.046153:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.046250:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c92b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.046466:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115072 00000100:00100000:1.0:1787430710.046472:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115072 00000100:00100000:1.0:1787430710.046508:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787430710.046515:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856115072:12345-0@lo:501: 00000100:00100000:1.0:1787430710.046785:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856115072:12345-0@lo:501: Request processed in 269us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.046794:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787430710.046811:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115072:0@lo:501: 00000100:00100000:0.0:1787430710.046843:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115200:0@lo:503: 00000100:00100000:0.0:1787430710.046881:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.046963:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c92b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.047053:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115200 00000100:00100000:1.0:1787430710.047058:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115200 00000100:00100000:1.0:1787430710.047121:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787430710.047129:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856115200:12345-0@lo:503: 00000100:00100000:1.0:1787430710.047299:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856115200:12345-0@lo:503: Request processed in 170us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.047306:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787430710.047410:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115200:0@lo:503: 00000100:00100000:2.0:1787430710.047630:0:8542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8542:1874256856115328:0@lo:502: 00000100:00100000:2.0:1787430710.047669:0:8542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.047686:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115328 00000100:00100000:0.0:1787430710.047691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115328 00000100:00100000:2.0:1787430710.047692:0:8542:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fde63f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.047713:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787430710.047720:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:8542:x1874256856115328:12345-0@lo:502: 00000100:00100000:0.0:1787430710.047964:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:8542:x1874256856115328:12345-0@lo:502: Request processed in 180us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.047974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787430710.048073:0:8542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8542:1874256856115328:0@lo:502: 00000100:00100000:2.0:1787430710.048114:0:8542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8542:1874256856115456:0@lo:502: 00000100:00100000:2.0:1787430710.048151:0:8542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.048240:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115456 00000100:00100000:2.0:1787430710.048244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115456 00000100:00100000:2.0:1787430710.048863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787430710.048874:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:8542:x1874256856115456:12345-0@lo:502: 00000100:00100000:3.0:1787430710.048943:0:8542:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441840 going to sleep for 11 seconds 00000100:00100000:2.0:1787430710.049127:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:8542:x1874256856115456:12345-0@lo:502: Request processed in 255us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.049135:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787430710.049158:0:8542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8542:1874256856115456:0@lo:502: 00000040:00080000:0.0:1787430710.049189:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787430710.049433:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787430710.049452:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430710.049462:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.049473:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430710.049493:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787430710.049495:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787430710.049498:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787430710.049522:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.049530:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.049983:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430710.050002:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115584:0@lo:101: 00000100:00100000:1.0:1787430710.050043:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.050081:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.050424:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115584 00000100:00100000:0.0:1787430710.050430:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115584 00000100:00100000:0.0:1787430710.050464:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787430710.050472:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+10:5834:x1874256856115584:12345-0@lo:101: 00010000:00010000:0.0:1787430710.050485:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430710.050498:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0030a00/0x1fa5b1e070e68d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68d7e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.050522:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0030a00/0x1fa5b1e070e68d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d7e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.050696:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0030a00/0x1fa5b1e070e68d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d7e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.050707:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0030a00, rc 0) 00000100:00100000:0.0:1787430710.051140:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856115584:12345-0@lo:101: Request processed in 667us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.051148:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787430710.051649:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115584:0@lo:101: 00010000:00010000:2.0:1787430710.051668:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.051679:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430710.051737:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115712:0@lo:501: 00000100:00100000:2.0:1787430710.051771:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.051977:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441000 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.052026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115712 00000100:00100000:0.0:1787430710.052031:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115712 00000100:00100000:0.0:1787430710.052111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787430710.052120:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856115712:12345-0@lo:501: 00000100:00100000:0.0:1787430710.053655:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856115712:12345-0@lo:501: Request processed in 1530us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.053667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787430710.058006:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115712:0@lo:501: 00000100:00100000:2.0:1787430710.058062:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115840:0@lo:503: 00000100:00100000:2.0:1787430710.058133:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.058272:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441000 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.061404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115840 00000100:00100000:0.0:1787430710.061418:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115840 00000100:00100000:0.0:1787430710.061474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787430710.061485:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856115840:12345-0@lo:503: 00000100:00100000:0.0:1787430710.061729:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856115840:12345-0@lo:503: Request processed in 246us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.061735:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787430710.061763:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856115840:0@lo:503: 00000100:00100000:2.0:1787430710.062287:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8545:1874256856115968:0@lo:502: 00000100:00100000:2.0:1787430710.062367:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.062397:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.063013:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856115968 00000100:00100000:0.0:1787430710.063020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856115968 00000100:00100000:0.0:1787430710.063062:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787430710.063071:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:8545:x1874256856115968:12345-0@lo:502: 00000100:00100000:0.0:1787430710.063273:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:8545:x1874256856115968:12345-0@lo:502: Request processed in 203us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.063287:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787430710.063420:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8545:1874256856115968:0@lo:502: 00000020:01000000:2.0:1787430710.063460:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430710.063470:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.063473:0:8545:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787430710.063480:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787430710.063506:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8545:1874256856116096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.063546:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.063589:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.063653:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116096 00000100:00100000:0.0:1787430710.063658:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116096 00000100:00100000:0.0:1787430710.063695:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787430710.063703:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:8545:x1874256856116096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.064079:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:8545:x1874256856116096:12345-0@lo:502:llog_process_th.0 Request processed in 376us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.064087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787430710.065509:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8545:1874256856116096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430710.065550:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430710.065557:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.065559:0:8545:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787430710.065565:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787430710.065738:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787430710.065760:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787430710.065771:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430710.065784:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430710.065800:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430710.065803:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c4de8800 from 4 10000000:01000000:3.0:1787430710.065806:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430710.065840:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430710.065849:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430710.065857:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430710.065877:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430710.065930:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430710.065979:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.066071:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116224 00000100:00100000:0.0:1787430710.066078:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116224 00000100:00100000:0.0:1787430710.066125:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787430710.066135:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+11:5834:x1874256856116224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.066147:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430710.066161:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68d8c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.066184:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.066195:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.066203:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0031600, rc 0) 00000100:00100000:0.0:1787430710.066252:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856116224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.066269:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787430710.066496:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430710.066511:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430710.066522:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430710.066589:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430710.066619:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430710.066695:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.068608:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116352 00000100:00100000:0.0:1787430710.068624:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116352 00000100:00100000:1.0:1787430710.073889:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787430710.073905:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856116352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.074235:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856116352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (7614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.074244:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787430710.074363:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.074415:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.074460:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.074712:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430710.074829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116480 00000100:00100000:3.0:1787430710.074836:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116480 00000100:00100000:3.0:1787430710.074871:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787430710.074879:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856116480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430710.075102:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856116480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430710.075109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787430710.075145:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430710.075315:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8549:1874256856116608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430710.075371:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430710.075390:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116608 00000100:00100000:3.0:1787430710.075394:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116608 00000100:00100000:3.0:1787430710.075412:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787430710.075418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:8549:x1874256856116608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430710.075626:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:8549:x1874256856116608:12345-0@lo:502:llog_process_th.0 Request processed in 207us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430710.075633:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787430710.075667:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430710.075680:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8549:1874256856116608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430710.075702:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430710.075711:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430710.075714:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787430710.075720:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f1c4de8800 00000020:00000080:3.0:1787430710.075724:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787430710.076382:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8549:1874256856116736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430710.076425:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.076441:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.077136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116736 00000100:00100000:0.0:1787430710.077144:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116736 00000100:00100000:0.0:1787430710.077193:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787430710.077202:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:8549:x1874256856116736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.077421:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:8549:x1874256856116736:12345-0@lo:502:llog_process_th.0 Request processed in 219us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.077431:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787430710.077456:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8549:1874256856116736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430710.077488:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430710.077496:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.077498:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787430710.077503:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787430710.077606:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787430710.077629:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430710.077639:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.077651:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.077661:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787430710.077664:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2c562b800 from 39 10000000:01000000:0.0:1787430710.077667:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430710.077692:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.077701:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.077722:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.077738:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.077769:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.077843:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c10903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430710.081182:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116864 00000100:00100000:2.0:1787430710.081197:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116864 00000100:00100000:2.0:1787430710.081293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787430710.081312:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+12:5834:x1874256856116864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430710.081344:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430710.081363:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68d9a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.081392:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d9a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.081402:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d9a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.081411:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75000, rc 0) 00000100:00100000:2.0:1787430710.081494:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856116864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.081502:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787430710.081545:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430710.081563:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.081583:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430710.081648:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.081683:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.085178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856116992 00000100:00100000:1.0:1787430710.085191:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856116992 00000100:00100000:1.0:1787430710.085238:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787430710.085250:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856116992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.085836:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856116992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 587us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.085845:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787430710.088634:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441000 going to sleep for 11 seconds 00000100:00100000:2.0:1787430710.088675:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856116992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.088732:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.088808:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.088838:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441000 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.089022:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117120 00000100:00100000:0.0:1787430710.089030:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117120 00000100:00100000:0.0:1787430710.089077:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787430710.089087:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856117120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.089354:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856117120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.089361:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787430710.089636:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.090787:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8555:1874256856117248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.091703:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.091800:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117248 00000100:00100000:0.0:1787430710.091807:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117248 00000100:00100000:2.0:1787430710.091816:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.091852:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787430710.091862:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:8555:x1874256856117248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.092206:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:8555:x1874256856117248:12345-0@lo:502:llog_process_th.0 Request processed in 345us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.092214:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787430710.092609:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8555:1874256856117248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.092668:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8555:1874256856117376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.092712:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.092737:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.092879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117376 00000100:00100000:0.0:1787430710.092886:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117376 00000100:00100000:0.0:1787430710.092919:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787430710.092928:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:8555:x1874256856117376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.093083:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:8555:x1874256856117376:12345-0@lo:502:llog_process_th.0 Request processed in 155us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.093118:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8555:1874256856117376:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787430710.093139:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1787430710.093240:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000020:01000000:0.0:1787430710.093273:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787430710.093295:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430710.093304:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.093315:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.093324:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787430710.093341:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787430710.093344:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430710.093654:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.093664:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.093674:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.093689:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.093722:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.093752:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.093757:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117504 00000100:00100000:1.0:1787430710.093761:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117504 00000100:00100000:1.0:1787430710.093788:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787430710.093796:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+13:5834:x1874256856117504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430710.093805:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430710.093815:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a5a00/0x1fa5b1e070e68daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68da8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.093837:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a5a00/0x1fa5b1e070e68daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68da8 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.093848:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a5a00/0x1fa5b1e070e68daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68da8 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.093856:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5a00, rc 0) 00000100:00100000:1.0:1787430710.093897:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856117504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.093903:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787430710.093933:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.093945:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.093962:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.093996:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.094019:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.094040:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.094141:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117632 00000100:00100000:1.0:1787430710.094144:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117632 00000100:00100000:1.0:1787430710.094164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787430710.094169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856117632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.094582:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.094666:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.094790:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.094810:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.094845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856117632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 674us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.094861:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787430710.094882:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117760 00000100:00100000:1.0:1787430710.094885:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117760 00000100:00100000:1.0:1787430710.094951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787430710.094959:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856117760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.095111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856117760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.095118:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787430710.095213:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856117760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.095430:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8557:1874256856117888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.095465:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.095483:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856117888 00000100:00100000:0.0:1787430710.095487:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856117888 00000100:00100000:0.0:1787430710.095675:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787430710.095682:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8557:x1874256856117888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.095818:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8557:x1874256856117888:12345-0@lo:502:llog_process_th.0 Request processed in 136us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.095825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787430710.095862:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.095874:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8557:1874256856117888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430710.095895:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430710.095908:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430710.095910:0:8557:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787430710.095916:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787430710.095936:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8557:1874256856118016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.095965:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.095980:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.096700:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118016 00000100:00100000:0.0:1787430710.096706:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118016 00000100:00100000:0.0:1787430710.096733:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787430710.096740:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8557:x1874256856118016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.096878:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:8557:x1874256856118016:12345-0@lo:502:llog_process_th.0 Request processed in 139us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.096884:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787430710.096939:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8557:1874256856118016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430710.096964:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430710.096969:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430710.096971:0:8557:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787430710.096976:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787430710.097024:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787430710.097039:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787430710.097047:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.097058:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.097066:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430710.097069:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2c562b800 from 4 10000000:01000000:0.0:1787430710.097072:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430710.097101:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.097109:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.097117:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.097131:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.097160:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.097183:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c1090a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.097196:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118144 00000100:00100000:0.0:1787430710.097199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118144 00000100:00100000:0.0:1787430710.097222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787430710.097229:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:5834:x1874256856118144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.097238:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430710.097250:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68db6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.097269:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.097278:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.097287:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0031200, rc 0) 00000100:00100000:0.0:1787430710.097344:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856118144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.097351:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787430710.097424:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430710.097536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.097546:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430710.097604:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.097633:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.097654:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64416c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.097685:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118272 00000100:00100000:1.0:1787430710.097690:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118272 00000100:00100000:1.0:1787430710.097718:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787430710.097726:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856118272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.097942:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856118272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.097950:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787430710.097966:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.097996:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.098037:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.098053:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430710.098064:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118400 00000100:00100000:2.0:1787430710.098068:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118400 00000100:00100000:2.0:1787430710.098092:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787430710.098119:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856118400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.098442:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856118400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 342us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.098450:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787430710.098505:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.099612:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8559:1874256856118528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.099666:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.099697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118528 00000100:00100000:2.0:1787430710.099702:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118528 00000100:00100000:2.0:1787430710.099736:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787430710.099745:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8559:x1874256856118528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.099983:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8559:x1874256856118528:12345-0@lo:502:llog_process_th.0 Request processed in 239us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.099990:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787430710.100033:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430710.100049:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8559:1874256856118528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430710.100082:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430710.100091:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.100094:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787430710.100103:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2c562b800 00000020:00000080:2.0:1787430710.100107:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430710.100183:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8559:1874256856118656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.100215:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.100238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118656 00000100:00100000:2.0:1787430710.100242:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.100245:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118656 00000100:00100000:0.0:1787430710.100281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787430710.100289:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8559:x1874256856118656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.100438:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:8559:x1874256856118656:12345-0@lo:502:llog_process_th.0 Request processed in 149us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.100446:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8559:1874256856118656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.100447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000020:01000000:2.0:1787430710.100469:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430710.100474:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.100476:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787430710.100480:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787430710.100530:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787430710.100557:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430710.100578:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100590:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.100599:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787430710.100601:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2d0492800 from 39 10000000:01000000:0.0:1787430710.100604:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787430710.100631:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100640:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100649:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.100668:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.100704:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.100726:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.100738:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118784 00000100:00100000:0.0:1787430710.100742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118784 00000100:00100000:0.0:1787430710.100763:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787430710.100769:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:5834:x1874256856118784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.100777:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430710.100788:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c0031400/0x1fa5b1e070e68dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68dc4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100807:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c0031400/0x1fa5b1e070e68dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68dc4 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100817:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c0031400/0x1fa5b1e070e68dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68dc4 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100824:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c0031400, rc 0) 00000100:00100000:0.0:1787430710.100850:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856118784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.100856:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787430710.100899:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.100911:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.100919:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.100954:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.100974:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.100991:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c571bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.101000:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856118912 00000100:00100000:0.0:1787430710.101003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856118912 00000100:00100000:0.0:1787430710.101024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787430710.101030:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856118912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.101203:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856118912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.101209:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787430710.101234:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856118912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.101253:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.101279:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.101289:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c571bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.101298:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119040 00000100:00100000:0.0:1787430710.101301:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119040 00000100:00100000:0.0:1787430710.101317:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787430710.101322:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856119040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.101452:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856119040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.101458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787430710.101492:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.102992:0:8561:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8561:1874256856119168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.103068:0:8561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.103233:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119168 00000100:00100000:0.0:1787430710.103238:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119168 00000100:00100000:0.0:1787430710.103272:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787430710.103279:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8561:x1874256856119168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.103818:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8561:x1874256856119168:12345-0@lo:502:llog_process_th.0 Request processed in 536us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.103826:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787430710.103880:0:8561:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.103898:0:8561:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8561:1874256856119168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.103945:0:8561:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8561:1874256856119296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.103982:0:8561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.104069:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119296 00000100:00100000:0.0:1787430710.104074:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119296 00000100:00100000:0.0:1787430710.104171:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787430710.104181:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8561:x1874256856119296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.104538:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:8561:x1874256856119296:12345-0@lo:502:llog_process_th.0 Request processed in 360us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.104546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787430710.104704:0:8561:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.104717:0:8561:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8561:1874256856119296:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787430710.104736:0:8561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787430710.104789:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787430710.104807:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787430710.104817:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.104827:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.104836:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787430710.104843:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787430710.104847:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430710.104869:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.104877:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.104885:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.104899:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.104926:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.104943:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.104958:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119424 00000100:00100000:0.0:1787430710.104962:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119424 00000100:00100000:0.0:1787430710.104997:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787430710.105017:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856119424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.105025:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430710.105037:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f30216cc00/0x1fa5b1e070e68dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68dd2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.105056:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f30216cc00/0x1fa5b1e070e68dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68dd2 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.105068:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f30216cc00/0x1fa5b1e070e68dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68dd2 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.105077:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216cc00, rc 0) 00000100:00100000:1.0:1787430710.105239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856119424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.105244:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787430710.105294:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.105308:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.105314:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430710.105714:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.105735:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.105779:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.105808:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119552 00000100:00100000:0.0:1787430710.105811:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119552 00000100:00100000:1.0:1787430710.105891:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787430710.105897:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856119552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.106101:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856119552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.106122:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787430710.106182:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.106211:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.106241:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.106261:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.106276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119680 00000100:00100000:0.0:1787430710.106281:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119680 00000100:00100000:1.0:1787430710.106320:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787430710.106345:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856119680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.106490:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856119680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.106497:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787430710.106527:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856119680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430710.106948:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8562:1874256856119808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430710.106996:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.107032:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119808 00000100:00100000:0.0:1787430710.107037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119808 00000100:00100000:0.0:1787430710.107064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787430710.107070:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:8562:x1874256856119808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430710.107101:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.107313:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:8562:x1874256856119808:12345-0@lo:502:llog_process_th.0 Request processed in 243us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.107321:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787430710.107876:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8562:1874256856119808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430710.107913:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430710.107923:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430710.107926:0:8562:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787430710.107932:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787430710.107956:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8562:1874256856119936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430710.108001:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.108192:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856119936 00000100:00100000:0.0:1787430710.108197:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856119936 00000100:00100000:0.0:1787430710.108233:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787430710.108240:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:8562:x1874256856119936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.108746:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:8562:x1874256856119936:12345-0@lo:502:llog_process_th.0 Request processed in 505us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.108753:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787430710.109781:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430710.109842:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8562:1874256856119936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430710.109903:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430710.109913:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430710.109916:0:8562:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787430710.109923:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787430710.110084:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787430710.110186:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787430710.110202:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.110214:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430710.110235:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430710.110238:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2d0492800 from 4 10000000:01000000:0.0:1787430710.110241:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430710.110271:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.110279:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.110290:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.110309:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.110766:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430710.110870:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2feca30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.110885:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120064 00000100:00100000:1.0:1787430710.110893:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120064 00000100:00100000:1.0:1787430710.110937:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787430710.110947:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856120064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430710.110958:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430710.110971:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68de0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.110994:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.111006:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.111014:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4600, rc 0) 00000100:00100000:1.0:1787430710.111065:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856120064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.111078:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787430710.111114:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430710.111129:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430710.111139:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430710.111216:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.111245:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.111265:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d8bcb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.111677:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120192 00000100:00100000:0.0:1787430710.111682:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120192 00000100:00100000:0.0:1787430710.111725:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787430710.111732:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856120192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.112008:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856120192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.112017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787430710.112022:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.112062:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.112119:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.112167:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.112528:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120320 00000100:00100000:0.0:1787430710.112534:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120320 00000100:00100000:0.0:1787430710.112584:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787430710.112594:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856120320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.112960:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856120320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 367us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.112969:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787430710.113157:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430710.115544:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8565:1874256856120448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.115669:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.115719:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441180 going to sleep for 11 seconds 00000100:00100000:0.0:1787430710.115834:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120448 00000100:00100000:0.0:1787430710.115844:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120448 00000100:00100000:0.0:1787430710.115909:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787430710.115930:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8565:x1874256856120448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430710.116504:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8565:x1874256856120448:12345-0@lo:502:llog_process_th.0 Request processed in 579us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.116514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787430710.116614:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8565:1874256856120448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430710.116653:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430710.116666:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.116669:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787430710.116681:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2d0492800 00000020:00000080:2.0:1787430710.116684:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430710.116842:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8565:1874256856120576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.116884:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430710.116913:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441180 going to sleep for 11 seconds 00000100:00100000:2.0:1787430710.117401:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120576 00000100:00100000:2.0:1787430710.117409:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120576 00000100:00100000:2.0:1787430710.117446:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787430710.117454:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8565:x1874256856120576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430710.117725:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:8565:x1874256856120576:12345-0@lo:502:llog_process_th.0 Request processed in 271us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.117736:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787430710.117800:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:8565:1874256856120576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430710.117834:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430710.117841:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430710.117844:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787430710.117850:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787430710.118297:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787430710.118352:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430710.118364:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118378:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430710.118388:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787430710.118391:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0f2c3458000 from 1 10000000:01000000:1.0:1787430710.118394:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787430710.118433:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118440:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118452:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430710.118478:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.118547:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.118599:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3215900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.118632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120704 00000100:00100000:1.0:1787430710.118645:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120704 00000100:00100000:1.0:1787430710.118691:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787430710.118701:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856120704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430710.118715:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430710.118727:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4e00/0x1fa5b1e070e68df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68dee expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118749:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4e00/0x1fa5b1e070e68df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68dee expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118759:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a4e00/0x1fa5b1e070e68df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68dee expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118767:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4e00, rc 0) 00000100:00100000:1.0:1787430710.118807:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856120704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.118813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787430710.118856:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430710.118869:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.118878:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430710.118922:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.118950:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430710.118967:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3215900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430710.118979:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120832 00000100:00100000:1.0:1787430710.118990:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120832 00000100:00100000:1.0:1787430710.119012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787430710.119018:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856120832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.119258:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856120832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (307us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430710.119265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787430710.119312:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856120832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787430710.119355:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787430710.119361:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430710.119379:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430710.234695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430710.234857:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841413888 00000100:00100000:2.0:1787430710.234868:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841413888 00000100:00100000:2.0:1787430710.234952:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 181 00000100:00100000:2.0:1787430710.234962:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:5607:x1874256841413888:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430710.234981:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430710.234998:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc144ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.235038:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.235051:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430710.235061:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75600, rc 0) 00000100:00100000:2.0:1787430710.235233:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841413888:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 272us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430710.235249:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 181 00000100:00100000:3.0:1787430710.239498:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430710.239543:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414016 00000100:00100000:1.0:1787430710.239554:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414016 00000100:00100000:1.0:1787430710.239677:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 182 00000100:00100000:1.0:1787430710.239688:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841414016:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430710.240034:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841414016:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 346us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.240042:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 182 00000100:00100000:3.0:1787430710.242444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430710.242512:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414144 00000100:00100000:0.0:1787430710.242524:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414144 00000100:00100000:0.0:1787430710.242587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 183 00000100:00100000:0.0:1787430710.242597:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841414144:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430710.243987:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:5607:x1874256841414144:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 1382us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.244011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 183 00000100:00100000:2.0:1787430710.255958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430710.256371:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414272 00000100:00100000:1.0:1787430710.256382:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414272 00000100:00100000:1.0:1787430710.256504:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 184 00000100:00100000:1.0:1787430710.256515:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:6130:x1874256841414272:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430710.256772:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:6130:x1874256841414272:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 257us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430710.256786:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 184 00000100:00100000:3.0:1787430710.258565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430710.258654:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414400 00000100:00100000:0.0:1787430710.258666:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414400 00000100:00100000:0.0:1787430710.258731:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 185 00000100:00100000:0.0:1787430710.258745:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:6130:x1874256841414400:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430710.259387:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:6130:x1874256841414400:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 644us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430710.259398:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 185 00010000:00010000:0.0:1787430710.300911:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430710.493792:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856120960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430710.493866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430710.494233:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856120960 00000100:00100000:3.0:1787430710.494242:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856120960 00000100:00100000:3.0:1787430710.494309:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430710.494321:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856120960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430710.494374:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430710.494475:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856120960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430710.494483:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787430710.494495:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787430710.494541:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe630000 x1874256856120960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430710.494631:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856120960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787430711.324595:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430711.517163:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856121344:0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.517265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430711.517363:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787430711.517370:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856121216:0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.517407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430711.517424:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856121728:0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.517449:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430711.517551:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121344 00000100:00100000:2.0:1787430711.517560:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121344 00000100:00100000:2.0:1787430711.517619:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121216 00000100:00100000:2.0:1787430711.517623:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121216 00000100:00100000:2.0:1787430711.517645:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430711.517654:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856121344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.517716:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856121344:12345-0@lo:400:kworker.0 Request processed in 62us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430711.517736:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430711.517757:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430711.517764:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856121216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.517792:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856121216:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430711.517818:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430711.517869:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856121216:0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.517882:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856121344:0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.519481:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856121088:0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.519590:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430711.519645:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856121600:0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.519675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430711.519712:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430711.519720:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856121472:0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.519748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430711.519839:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121728 00000100:00100000:1.0:1787430711.519848:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121728 00000100:00100000:1.0:1787430711.519902:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121472 00000100:00100000:1.0:1787430711.519904:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121472 00000100:00100000:1.0:1787430711.519921:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430711.519931:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856121728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.519990:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856121728:12345-0@lo:400:kworker.0 Request processed in 59us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430711.519997:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430711.520020:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430711.520027:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787430711.520028:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856121472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430711.520044:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787430711.520068:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430711.520069:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856121472:12345-0@lo:400:kworker.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00080000:0.0:1787430711.520075:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430711.520096:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430711.520118:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121600 00000100:00100000:1.0:1787430711.520122:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121600 00000100:00100000:1.0:1787430711.520158:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787430711.520178:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856121600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787430711.520197:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430711.520219:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856121600:12345-0@lo:400:kworker.0 Request processed in 42us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430711.520228:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787430711.520271:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fdee4000 x1874256856121472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430711.520590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121088 00000100:00100000:2.0:1787430711.520597:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121088 00000100:00100000:2.0:1787430711.520642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787430711.520651:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856121088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430711.520697:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856121088:12345-0@lo:400:kworker.0 Request processed in 47us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430711.520704:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787430711.520752:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430711.520767:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856121856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430711.521013:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856121472:0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.522025:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856121088:0@lo:400:kworker.0 00000100:00100000:1.0:1787430711.522046:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856121600:0@lo:400:kworker.0 00000100:00100000:3.0:1787430711.522089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430711.522143:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121856 00000100:00100000:3.0:1787430711.522161:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121856 00000100:00100000:3.0:1787430711.522210:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430711.522222:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856121856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430711.522276:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430711.522647:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856121856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 427us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430711.522657:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787430711.522697:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec22d180 x1874256856121856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430711.522717:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856121856:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787430711.525963:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fdee7100 x1874256856121728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430711.525988:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856121728:0@lo:400:kworker.0 00010000:00010000:1.0:1787430712.354405:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430713.363694:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787430713.370804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430713.370854:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430713.370884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430713.370904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430713.370937:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414784 00000100:00100000:2.0:1787430713.370945:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414784 00000100:00100000:2.0:1787430713.370997:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414912 00000100:00100000:2.0:1787430713.371000:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414912 00000100:00100000:2.0:1787430713.371027:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430713.371037:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841414784:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430713.371102:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841414784:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430713.371110:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430713.371124:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430713.371130:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841414912:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430713.371163:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841414912:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430713.371170:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430713.371186:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414656 00000100:00100000:2.0:1787430713.371189:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414656 00000100:00100000:2.0:1787430713.371213:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:2.0:1787430713.371219:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841414656:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430713.371240:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841414656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430713.371246:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00080000:2.0:1787430713.371262:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430713.371265:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430713.371267:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430713.371379:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841414528 00000100:00100000:3.0:1787430713.371383:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841414528 00000100:00100000:3.0:1787430713.371414:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 187 00000100:00100000:3.0:1787430713.371421:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2373:x1874256841414528:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430713.371446:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2373:x1874256841414528:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430713.371453:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 187 00010000:00010000:2.0:1787430713.374113:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430714.396576:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430715.421533:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430715.616786:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856121984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430715.616867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430715.616951:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856121984 00000100:00100000:0.0:1787430715.616958:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856121984 00000100:00100000:0.0:1787430715.617018:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430715.617028:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856121984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430715.617064:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430715.617118:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856121984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430715.617127:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787430715.617153:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787430715.617184:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe630a80 x1874256856121984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430715.617207:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856121984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787430716.444491:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430716.636672:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.636777:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.636862:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787430716.636870:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856122112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430716.636905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.636945:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856122624:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.636977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.637014:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.637766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.637815:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856122752:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.637848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430716.637877:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122240 00000100:00100000:2.0:1787430716.637888:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122240 00000100:00100000:2.0:1787430716.637950:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787430716.637952:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787430716.637962:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856122368:0@lo:400:kworker.0 00000100:00100000:2.0:1787430716.637964:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.638006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.638114:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856122880:0@lo:400:kworker.0 00000100:00100000:1.0:1787430716.638184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122496 00000100:00100000:1.0:1787430716.638190:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122496 00000100:00100000:1.0:1787430716.638244:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122752 00000100:00100000:1.0:1787430716.638248:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122752 00000100:00100000:1.0:1787430716.638267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122368 00000100:00100000:1.0:1787430716.638270:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122368 00000100:00100000:1.0:1787430716.638291:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430716.638300:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856122496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787430716.638607:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430716.638634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430716.638646:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856122752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430716.638743:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856122240:12345-0@lo:400:kworker.0 Request processed in 782us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430716.638753:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787430716.638808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430716.638856:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.638897:0:6884:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787430716.638906:0:6884:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787430716.638933:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122112 00000100:00100000:3.0:1787430716.638937:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122112 00000100:00100000:3.0:1787430716.639169:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430716.639184:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856122112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430716.639223:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430716.639286:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856122112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.639293:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430716.639322:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122624 00000100:00100000:3.0:1787430716.639347:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122624 00000100:00100000:3.0:1787430716.639377:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856122880 00000100:00100000:3.0:1787430716.639381:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856122880 00000100:00100000:3.0:1787430716.639403:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430716.639412:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856122624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430716.639584:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856122496:12345-0@lo:400:kworker.0 Request processed in 1283us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430716.639594:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430716.639632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430716.639738:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856122624:12345-0@lo:400:kworker.0 Request processed in 326us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.639753:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430716.639771:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430716.639780:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856122880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.639824:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856122880:12345-0@lo:400:kworker.0 Request processed in 47us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430716.639831:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430716.639883:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856122368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430716.639926:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856122368:12345-0@lo:400:kworker.0 Request processed in 47us (1920us total) trans 0 rc 0/0 00000100:00080000:3.0:1787430716.640125:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787430716.640172:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec22d180 x1874256856122112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430716.640198:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856122112:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787430716.640217:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec22df80 x1874256856122624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430716.640227:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856122624:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.640246:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787430716.640295:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856122368:0@lo:400:kworker.0 00010000:00080000:3.0:1787430716.640311:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c9397b80 x1874256856122880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430716.640321:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856122880:0@lo:400:kworker.0 00000100:00100000:0.0:1787430716.640544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856122752:12345-0@lo:400:kworker.0 Request processed in 1901us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430716.640554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787430716.640854:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856122752:0@lo:400:kworker.0 00000100:00100000:1.0:1787430716.641283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000001:02000400:1.0:1787430716.730621:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing yml_node 00010000:00010000:2.0:1787430717.469460:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430718.489093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430718.489220:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430718.489267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430718.489363:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415424 00000100:00100000:1.0:1787430718.489371:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415040 00000100:00100000:0.0:1787430718.489378:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415424 00000100:00100000:1.0:1787430718.489379:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415040 00000100:00100000:3.0:1787430718.489388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430718.489453:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415296 00000100:00100000:3.0:1787430718.489462:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415296 00000100:00100000:1.0:1787430718.489476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 189 00000100:00100000:1.0:1787430718.489490:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2371:x1874256841415040:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430718.489534:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:3.0:1787430718.489550:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841415296:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430718.489577:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2371:x1874256841415040:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430718.489586:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 189 00000100:00100000:0.0:1787430718.489602:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:0.0:1787430718.489617:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841415424:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430718.489652:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841415424:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (433us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430718.489655:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430718.489662:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430718.489663:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787430718.489725:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841415296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 178us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430718.489737:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:2.0:1787430718.490988:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415168 00000100:00100000:2.0:1787430718.491001:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415168 00000100:00080000:1.0:1787430718.491174:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430718.491224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:2.0:1787430718.491249:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2371:x1874256841415168:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430718.492043:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2371:x1874256841415168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 791us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430718.492054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00010000:00010000:1.0:1787430718.492720:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430719.517757:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430719.742743:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.63 00010000:00010000:2.0:1787430720.540615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430720.732800:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856123008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430720.732879:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430720.733059:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123008 00000100:00100000:0.0:1787430720.733069:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123008 00000100:00100000:0.0:1787430720.733137:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430720.733147:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856123008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430720.733185:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430720.733229:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856123008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430720.733252:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787430720.733573:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe630a80 x1874256856123008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430720.733596:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856123008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787430720.733698:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787430721.357824:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.63 00010000:00010000:1.0:1787430721.564590:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430721.756513:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856123264:0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.756592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.756670:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430721.756678:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856123392:0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.756712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.756749:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430721.756784:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.756823:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787430721.756829:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856123520:0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.756857:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.756900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123264 00000100:00100000:3.0:1787430721.756917:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123264 00000100:00100000:3.0:1787430721.756976:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787430721.756987:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856123264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.757049:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856123264:12345-0@lo:400:kworker.0 Request processed in 64us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.757058:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787430721.757095:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123392 00000100:00100000:3.0:1787430721.757100:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123392 00000100:00100000:3.0:1787430721.757130:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123520 00000100:00100000:3.0:1787430721.757146:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123520 00000100:00100000:3.0:1787430721.757184:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430721.757193:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430721.757222:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787430721.757235:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856123520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.757243:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856123392:12345-0@lo:400:kworker.0 Request processed in 51us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.757252:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787430721.757276:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430721.757287:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856123520:12345-0@lo:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.757295:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430721.757314:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856123392:0@lo:400:kworker.0 00000100:00100000:2.0:1787430721.757360:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123136 00000100:00100000:3.0:1787430721.757363:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856123264:0@lo:400:kworker.0 00000100:00100000:2.0:1787430721.757365:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123136 00000100:00100000:2.0:1787430721.757408:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430721.757418:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856123136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430721.757446:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787430721.757471:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430721.757485:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856123136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430721.757493:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430721.757495:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856123520:0@lo:400:kworker.0 00010000:00080000:3.0:1787430721.757513:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c9396d80 x1874256856123136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430721.757527:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430721.757663:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430721.757716:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856123648:0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.757752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430721.757783:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123648 00000100:00100000:3.0:1787430721.757787:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123648 00000100:00100000:3.0:1787430721.757826:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430721.757833:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856123648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.757864:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856123648:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430721.757870:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430721.757881:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430721.757888:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856123776:0@lo:400:kworker.0 00000100:00100000:3.0:1787430721.757913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787430721.757963:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe888e00 x1874256856123648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430721.757973:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856123648:0@lo:400:kworker.0 00000100:00100000:1.0:1787430721.758046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123776 00000100:00100000:1.0:1787430721.758052:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123776 00000100:00100000:1.0:1787430721.758089:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430721.758096:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856123776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430721.758149:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856123776:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430721.758156:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787430721.760543:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430721.760606:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856123776:0@lo:400:kworker.0 00010000:00010000:3.0:1787430722.588651:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787430722.956612:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.63 00000100:00100000:3.0:1787430723.610903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430723.610953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430723.611008:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415552 00000100:00100000:1.0:1787430723.611018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415552 00000100:00100000:3.0:1787430723.611061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430723.611081:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 191 00000100:00100000:3.0:1787430723.611099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430723.611108:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2372:x1874256841415552:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430723.611174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415680 00000100:00100000:2.0:1787430723.611179:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415680 00000100:00100000:2.0:1787430723.611218:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:2.0:1787430723.611225:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2372:x1874256841415680:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430723.611318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2372:x1874256841415680:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430723.611364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00080000:2.0:1787430723.611387:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430723.611758:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2372:x1874256841415552:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 654us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.611765:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 191 00000100:00100000:0.0:1787430723.613103:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415808 00000100:00100000:1.0:1787430723.613104:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841415936 00000100:00100000:1.0:1787430723.613113:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415936 00000100:00100000:0.0:1787430723.613113:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841415808 00000100:00080000:2.0:1787430723.613238:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430723.613241:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430723.613348:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787430723.613358:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841415936:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430723.613478:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841415936:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 123us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.613485:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787430723.613506:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:1.0:1787430723.613512:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841415808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430723.613533:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841415808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 22us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430723.613538:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00010000:00010000:3.0:1787430723.614908:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430723.987729:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 16:32:02 EDT 2026 00010000:00010000:1.0:1787430724.636425:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430725.660576:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430725.852759:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856123904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430725.852850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430725.853095:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856123904 00000100:00100000:1.0:1787430725.853104:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856123904 00000100:00100000:1.0:1787430725.853186:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430725.853197:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856123904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430725.853231:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787430725.853299:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430725.853629:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856123904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 433us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430725.853649:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787430725.853723:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe632680 x1874256856123904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430725.853743:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856123904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787430726.685829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430726.876513:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430726.876547:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430726.878405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.878469:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856124288:0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.878531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.878577:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856124800:0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.878605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.878640:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430726.878647:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856124416:0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.878672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.878711:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124032 00000100:00100000:2.0:1787430726.878721:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124032 00000100:00100000:2.0:1787430726.878788:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430726.878798:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856124032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430726.878843:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430726.878892:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856124032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430726.878899:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430726.878926:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124288 00000100:00100000:2.0:1787430726.878929:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124288 00000100:00100000:2.0:1787430726.878972:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124416 00000100:00100000:2.0:1787430726.878975:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124416 00000100:00100000:2.0:1787430726.878997:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430726.879003:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856124288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.879282:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856124288:12345-0@lo:400:kworker.0 Request processed in 277us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430726.879293:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430726.879314:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787430726.879323:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856124416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787430726.879353:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430726.879363:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430726.879387:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124800 00000100:00100000:2.0:1787430726.879390:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856124416:12345-0@lo:400:kworker.0 Request processed in 69us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430726.879394:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124800 00000100:00100000:2.0:1787430726.879399:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430726.879436:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787430726.879449:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856124800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.879467:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856124416:0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.879484:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856124288:0@lo:400:kworker.0 00000100:00100000:1.0:1787430726.879511:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856124800:12345-0@lo:400:kworker.0 Request processed in 65us (903us total) trans 0 rc 0/0 00010000:00080000:2.0:1787430726.879520:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe889180 x1874256856124800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430726.879523:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430726.879540:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856124800:0@lo:400:kworker.0 00010000:00080000:2.0:1787430726.879584:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fdee7100 x1874256856124032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430726.879609:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856124032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430726.879632:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856124160:0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.879666:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.879703:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856124672:0@lo:400:kworker.0 00000100:00100000:1.0:1787430726.879738:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124160 00000100:00100000:2.0:1787430726.879743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430726.879745:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124160 00000100:00100000:2.0:1787430726.879767:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430726.879775:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856124544:0@lo:400:kworker.0 00000100:00100000:1.0:1787430726.879781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787430726.879790:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856124160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.879803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430726.879836:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856124160:0@lo:400:kworker.0 00000100:00100000:1.0:1787430726.879837:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856124160:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430726.879848:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787430726.879865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124672 00000100:00100000:2.0:1787430726.879869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124672 00000100:00100000:2.0:1787430726.879921:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787430726.879929:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856124672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.879969:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856124672:12345-0@lo:400:kworker.0 Request processed in 39us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430726.879977:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787430726.880003:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124544 00000100:00100000:2.0:1787430726.880007:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124544 00000100:00100000:2.0:1787430726.880047:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430726.880055:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856124544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.880089:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856124544:12345-0@lo:400:kworker.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430726.880095:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787430726.880111:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787430726.880125:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe888a80 x1874256856124544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430726.880137:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856124544:0@lo:400:kworker.0 00000100:00100000:2.0:1787430726.880147:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856124672:0@lo:400:kworker.0 00010000:00010000:1.0:1787430727.711664:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430728.733774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430728.733833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430728.733846:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416192 00000100:00100000:3.0:1787430728.733858:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416192 00000100:00100000:3.0:1787430728.733939:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:3.0:1787430728.733953:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841416192:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430728.734028:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841416192:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.734036:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00010000:00010000:3.0:1787430728.734058:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430728.734066:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430728.734321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416064 00000100:00100000:0.0:1787430728.734340:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416064 00000100:00100000:0.0:1787430728.734372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 193 00000100:00100000:0.0:1787430728.734381:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2374:x1874256841416064:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430728.734419:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2374:x1874256841416064:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430728.734426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 193 00000100:00100000:1.0:1787430728.737240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430728.737378:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416320 00000100:00100000:0.0:1787430728.737387:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416320 00000100:00100000:0.0:1787430728.737451:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787430728.737461:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2370:x1874256841416320:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:0.0:1787430728.737498:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68d38 00000100:00080000:0.0:1787430728.737508:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430728.737554:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787430728.738032:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430728.739372:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430728.743498:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+2:2370:x1874256841416320:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 6028us (6256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430728.743514:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787430728.745263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430728.745413:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416448 00000100:00100000:3.0:1787430728.745423:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416448 00000100:00100000:3.0:1787430728.745486:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:3.0:1787430728.745499:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2370:x1874256841416448:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:3.0:1787430728.745534:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68d3f 00000100:00080000:3.0:1787430728.745545:0:6686:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3468000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787430728.745564:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787430728.745586:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787430728.745932:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+2:2370:x1874256841416448:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 435us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430728.745940:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00080000:0.0:1787430728.746023:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787430729.758636:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430730.783464:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430730.972848:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856124928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430730.972922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430730.972995:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856124928 00000100:00100000:0.0:1787430730.973002:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856124928 00000100:00100000:0.0:1787430730.973067:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787430730.973077:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856124928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430730.973191:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430730.973237:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856124928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430730.973245:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787430730.973458:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787430730.973510:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe632680 x1874256856124928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430730.973532:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856124928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787430731.804530:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430731.999131:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430731.999173:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856125056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430731.999243:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430732.000256:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125056 00000100:00100000:0.0:1787430732.000266:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125056 00000100:00100000:0.0:1787430732.000348:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787430732.000358:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856125056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430732.000387:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430732.000445:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856125056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430732.000450:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787430732.000609:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787430732.000644:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fdee5880 x1874256856125056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430732.000664:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856125056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430732.001024:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856125312:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430732.001089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430732.001094:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856125440:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001119:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430732.001165:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125312 00000100:00100000:2.0:1787430732.001170:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125312 00000100:00100000:2.0:1787430732.001203:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125440 00000100:00100000:2.0:1787430732.001206:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125440 00000100:00100000:2.0:1787430732.001233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430732.001240:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001279:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856125312:12345-0@lo:400:kworker.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430732.001285:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430732.001298:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787430732.001304:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001361:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856125440:12345-0@lo:400:kworker.0 Request processed in 58us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430732.001376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787430732.001403:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430732.001412:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856125184:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430732.001464:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856125696:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430732.001501:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430732.001506:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856125568:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430732.001553:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125184 00000100:00100000:2.0:1787430732.001556:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125184 00000100:00100000:2.0:1787430732.001584:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787430732.001590:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001622:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856125184:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430732.001628:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787430732.001651:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125696 00000100:00100000:2.0:1787430732.001654:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125696 00000100:00100000:2.0:1787430732.001676:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430732.001681:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856125696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001706:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856125696:12345-0@lo:400:kworker.0 Request processed in 25us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430732.001711:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787430732.001726:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125568 00000100:00100000:2.0:1787430732.001729:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125568 00000100:00100000:2.0:1787430732.001755:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430732.001768:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856125568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001794:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856125568:12345-0@lo:400:kworker.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430732.001798:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787430732.001816:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430732.001818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430732.001836:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856125440:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001847:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856125312:0@lo:400:kworker.0 00010000:00080000:2.0:1787430732.001871:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec133800 x1874256856125568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430732.001880:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856125568:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001888:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856125184:0@lo:400:kworker.0 00000100:00100000:2.0:1787430732.001895:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856125696:0@lo:400:kworker.0 00000001:00100000:2.0:1787430732.038249:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:2.0:1787430732.038258:0:6708:0:(genops.c:885:class_export_put()) final put ffffa0f2c562a000/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:0.0:1787430732.038285:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c562a000/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-OST0000 00000020:00000080:0.0:1787430732.038345:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c562f800 for lustre-OST0000 00010000:00010000:3.0:1787430732.829074:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787430733.068060:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:3.0:1787430733.068070:0:7647:0:(genops.c:885:class_export_put()) final put ffffa0f2c346c800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:2.0:1787430733.068678:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c346c800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-OST0001 00000020:00000080:3.0:1787430733.069062:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c3468000 for lustre-OST0001 00000100:00100000:3.0:1787430733.852112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430733.852268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787430733.852557:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430733.853169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416704 00000100:00100000:2.0:1787430733.853282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416704 00000100:00100000:0.0:1787430733.853295:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416576 00000100:00100000:0.0:1787430733.853302:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416576 00000100:00100000:2.0:1787430733.853399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:2.0:1787430733.853414:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841416704:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430733.853422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 195 00000100:00100000:0.0:1787430733.853433:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2373:x1874256841416576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:3.0:1787430733.853511:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430733.853819:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2373:x1874256841416576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 387us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430733.853844:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 195 00000100:00100000:2.0:1787430733.853932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841416704:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 521us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430733.853941:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00000001:02000400:3.0:1787430734.163109:0:10126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:32:12 (1787430732) === 00000100:00100000:1.0:1787430734.416805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.416914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416832 00000100:00100000:2.0:1787430734.416923:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416832 00000100:00100000:2.0:1787430734.416967:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 196 00000100:00100000:2.0:1787430734.416974:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:8122:x1874256841416832:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787430734.416989:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430734.417019:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc144b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430734.417050:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144b2 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430734.417061:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144b2 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430734.417070:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74800, rc 0) 00000100:00100000:2.0:1787430734.417146:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8122:x1874256841416832:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 171us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.417154:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 196 00000100:00100000:1.0:1787430734.420534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.420685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841416960 00000100:00100000:0.0:1787430734.420699:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841416960 00000100:00100000:0.0:1787430734.420868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 197 00000100:00100000:0.0:1787430734.420882:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8122:x1874256841416960:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787430734.421283:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8122:x1874256841416960:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 402us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.421382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 197 00000100:00100000:3.0:1787430734.423372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.423544:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417088 00000100:00100000:2.0:1787430734.423560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417088 00000100:00100000:2.0:1787430734.423623:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 198 00000100:00100000:2.0:1787430734.423634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8122:x1874256841417088:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787430734.424077:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8122:x1874256841417088:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 443us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.424086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 198 00000100:00100000:1.0:1787430734.427620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.427805:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417216 00000100:00100000:0.0:1787430734.427818:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417216 00000100:00100000:0.0:1787430734.427890:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 199 00000100:00100000:0.0:1787430734.427903:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8126:x1874256841417216:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430734.428567:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8126:x1874256841417216:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 661us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.428579:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 199 00000100:00100000:1.0:1787430734.444371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.444501:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417344 00000100:00100000:2.0:1787430734.444514:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417344 00000100:00100000:2.0:1787430734.444601:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 200 00000100:00100000:2.0:1787430734.444611:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8126:x1874256841417344:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430734.445007:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8126:x1874256841417344:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 396us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.445017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 200 00000100:00100000:3.0:1787430734.451086:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.451267:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417472 00000100:00100000:0.0:1787430734.451281:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417472 00000100:00100000:0.0:1787430734.451451:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 201 00000100:00100000:0.0:1787430734.451467:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:8122:x1874256841417472:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787430734.451504:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430734.451541:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f30216c000/0x1fa5b1e070e68e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc144dc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430734.451581:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f30216c000/0x1fa5b1e070e68e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144dc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430734.451618:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f30216c000/0x1fa5b1e070e68e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144dc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430734.451629:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216c000, rc 0) 00000100:00100000:0.0:1787430734.451714:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:8122:x1874256841417472:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 252us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.451720:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 201 00000100:00100000:1.0:1787430734.454299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.454543:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417600 00000100:00100000:2.0:1787430734.454558:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417600 00000100:00100000:2.0:1787430734.454635:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 202 00000100:00100000:2.0:1787430734.454649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:8122:x1874256841417600:12345-192.168.204.60@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787430734.454687:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787430734.454727:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787430734.454731:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787430734.454735:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787430734.454737:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787430734.456956:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:8122:x1874256841417600:12345-192.168.204.60@tcp:256:mount.lustre.0 Request processed in 2299us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430734.456971:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 202 00000100:00100000:3.0:1787430734.461725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.461917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417728 00000100:00100000:0.0:1787430734.461934:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417728 00000100:00100000:0.0:1787430734.462070:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 203 00000100:00100000:0.0:1787430734.462084:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:8122:x1874256841417728:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787430734.462121:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430734.462145:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc144e3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430734.462188:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430734.462201:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430734.462214:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216d200, rc 0) 00000100:00100000:0.0:1787430734.462301:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8122:x1874256841417728:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 219us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.462309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 203 00000100:00100000:3.0:1787430734.465648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430734.465843:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417856 00000100:00100000:1.0:1787430734.465856:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417856 00000100:00100000:1.0:1787430734.465978:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 204 00000100:00100000:1.0:1787430734.465992:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8122:x1874256841417856:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430734.466488:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8122:x1874256841417856:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 496us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430734.466498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 204 00000100:00100000:2.0:1787430734.468993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.469176:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841417984 00000100:00100000:0.0:1787430734.469210:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841417984 00000100:00100000:0.0:1787430734.469322:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 205 00000100:00100000:0.0:1787430734.469378:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8122:x1874256841417984:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787430734.469695:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8122:x1874256841417984:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 319us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.469714:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 205 00000100:00100000:3.0:1787430734.475183:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430734.475462:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418112 00000100:00100000:1.0:1787430734.475476:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418112 00000100:00100000:1.0:1787430734.475562:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 206 00000100:00100000:1.0:1787430734.475578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8130:x1874256841418112:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430734.475971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8130:x1874256841418112:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 395us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430734.475981:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 206 00000100:00100000:3.0:1787430734.478534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.478620:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418240 00000100:00100000:0.0:1787430734.478634:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418240 00000100:00100000:0.0:1787430734.478762:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 207 00000100:00100000:0.0:1787430734.478776:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8130:x1874256841418240:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430734.479121:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:8130:x1874256841418240:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 348us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.479131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 207 00000100:00100000:2.0:1787430734.483025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430734.483524:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418368 00000100:00100000:3.0:1787430734.483542:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418368 00000100:00100000:3.0:1787430734.483654:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:3.0:1787430734.483667:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2370:x1874256841418368:12345-192.168.204.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787430734.483717:0:9043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 24bdbdfb-c1b7-4700-ba76-999d38d57629@192.168.204.60@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1787430734.483788:0:9043:0:(genops.c:1385:class_connect()) connect: client 24bdbdfb-c1b7-4700-ba76-999d38d57629, cookie 0x1fa5b1e070e68e18 00000004:00100000:3.0:1787430734.483830:0:9043:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787430734.484159:0:9043:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec009800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430734.484265:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2370:x1874256841418368:12345-192.168.204.60@tcp:38:mount.lustre.0 Request processed in 598us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430734.484371:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:3.0:1787430734.486427:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430734.486480:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.486570:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418496 00000100:00100000:2.0:1787430734.486582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418496 00000100:00100000:0.0:1787430734.486583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418624 00000100:00100000:0.0:1787430734.486587:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418624 00000100:00100000:2.0:1787430734.486657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00080000:3.0:1787430734.486666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430734.486675:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+7:0:x1874256841418496:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787430734.486752:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787430734.486807:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787430734.486815:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+7:8122:x1874256841418624:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787430734.486830:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787430734.486873:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+7:0:x1874256841418496:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 206us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.486873:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+7:8122:x1874256841418624:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 59us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430734.486881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:2.0:1787430734.486884:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:1.0:1787430734.491497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430734.491624:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418752 00000100:00100000:3.0:1787430734.491655:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418752 00000100:00100000:3.0:1787430734.491726:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787430734.491739:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:8122:x1874256841418752:12345-192.168.204.60@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787430734.492124:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:8122:x1874256841418752:12345-192.168.204.60@tcp:40:mount.lustre.0 Request processed in 385us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.492146:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:2.0:1787430734.500275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.500373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430734.500412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430734.500533:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841418880 00000100:00100000:0.0:1787430734.500548:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841418880 00000100:00100000:0.0:1787430734.500640:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419008 00000100:00100000:0.0:1787430734.500644:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419008 00000100:00100000:1.0:1787430734.500698:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419136 00000100:00100000:1.0:1787430734.500703:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419136 00000100:00100000:1.0:1787430734.500751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:1.0:1787430734.500766:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:8122:x1874256841419136:12345-192.168.204.60@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787430734.501201:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787430734.501415:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:8122:x1874256841419136:12345-192.168.204.60@tcp:33:mount.lustre.0 Request processed in 650us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430734.501433:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:2.0:1787430734.501724:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:2.0:1787430734.501732:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1874256841418880:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787430734.501765:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 24bdbdfb-c1b7-4700-ba76-999d38d57629@192.168.204.60@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1787430734.501803:0:6683:0:(genops.c:1385:class_connect()) connect: client 24bdbdfb-c1b7-4700-ba76-999d38d57629, cookie 0x1fa5b1e070e68e1f 00002000:00100000:2.0:1787430734.501817:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24bdbdfb-c1b7-4700-ba76-999d38d57629/ffffa0f2ec100800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430734.501847:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430734.502083:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787430734.502133:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec106000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430734.502247:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2370:x1874256841418880:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 513us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.502255:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:2.0:1787430734.502278:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:2.0:1787430734.502283:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1874256841419008:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787430734.502302:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 24bdbdfb-c1b7-4700-ba76-999d38d57629@192.168.204.60@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1787430734.502320:0:6683:0:(genops.c:1385:class_connect()) connect: client 24bdbdfb-c1b7-4700-ba76-999d38d57629, cookie 0x1fa5b1e070e68e26 00002000:00100000:2.0:1787430734.502346:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 24bdbdfb-c1b7-4700-ba76-999d38d57629/ffffa0f2ec102000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430734.502365:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430734.502535:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787430734.502553:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec105800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430734.502596:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2370:x1874256841419008:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 310us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430734.502604:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00010000:00010000:1.0:1787430734.877669:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430735.900552:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430736.092552:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430736.092576:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856125824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430736.092645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430736.092786:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125824 00000100:00100000:0.0:1787430736.092810:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125824 00000100:00080000:3.0:1787430736.092866:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430736.092884:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787430736.092897:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856125824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430736.092920:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430736.092972:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856125824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430736.092979:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787430736.093074:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe632680 x1874256856125824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430736.093092:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856125824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787430736.924706:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430737.116492:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430737.116506:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856125952:0@lo:400:kworker.0 00000100:00100000:2.0:1787430737.116514:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856126208:0@lo:400:kworker.0 00000100:00100000:3.0:1787430737.116646:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856126336:0@lo:400:kworker.0 00000100:00100000:1.0:1787430737.116765:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856126592:0@lo:400:kworker.0 00000100:00100000:0.0:1787430737.116971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430737.117026:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856126464:0@lo:400:kworker.0 00000100:00100000:0.0:1787430737.117074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430737.117112:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126464 00000100:00100000:0.0:1787430737.117119:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126464 00000100:00100000:3.0:1787430737.118195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430737.118289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430737.118313:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430737.118319:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430737.118353:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856126720:0@lo:400:kworker.0 00000100:00100000:2.0:1787430737.118365:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856126080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430737.118405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430737.118479:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430737.118525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856125952 00000100:00100000:1.0:1787430737.118530:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856125952 00000100:00100000:3.0:1787430737.118710:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126336 00000100:00100000:0.0:1787430737.118712:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126720 00000100:00100000:3.0:1787430737.118715:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126336 00000100:00100000:0.0:1787430737.118719:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126720 00000100:00100000:0.0:1787430737.118767:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430737.118773:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126592 00000100:00100000:0.0:1787430737.118779:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856126464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430737.118780:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126592 00000100:00100000:3.0:1787430737.118809:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126208 00000100:00100000:3.0:1787430737.118814:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126208 00000100:00100000:3.0:1787430737.118845:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787430737.118850:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856126464:12345-0@lo:400:kworker.0 Request processed in 73us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430737.118857:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856126336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430737.118864:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430737.118909:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856126336:12345-0@lo:400:kworker.0 Request processed in 55us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430737.118915:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430737.118929:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430737.118936:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430737.118966:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856126592:12345-0@lo:400:kworker.0 Request processed in 31us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430737.118971:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430737.118983:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787430737.118989:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856126208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430737.119021:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787430737.119033:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856126208:12345-0@lo:400:kworker.0 Request processed in 42us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430737.119033:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856126720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430737.119075:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787430737.119087:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856126720:12345-0@lo:400:kworker.0 Request processed in 57us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430737.119096:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787430737.119099:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430737.119105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430737.119137:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856126336:0@lo:400:kworker.0 00000100:00100000:3.0:1787430737.119178:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126080 00000100:00100000:3.0:1787430737.119182:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126080 00000100:00100000:3.0:1787430737.119210:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430737.119217:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856126080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430737.119344:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430737.119386:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856126080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430737.119392:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787430737.119487:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe889c00 x1874256856126464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430737.119513:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856126464:0@lo:400:kworker.0 00000100:00100000:2.0:1787430737.119562:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856126208:0@lo:400:kworker.0 00010000:00080000:0.0:1787430737.119583:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe88b480 x1874256856126720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787430737.119584:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec131c00 x1874256856126080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430737.119587:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787430737.119603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856125952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430737.119619:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856126720:0@lo:400:kworker.0 00000100:00100000:2.0:1787430737.119625:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856126080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430737.119842:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856125952:12345-0@lo:400:kworker.0 Request processed in 244us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430737.119850:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787430737.119901:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856126592:0@lo:400:kworker.0 00000100:00100000:3.0:1787430737.119996:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856125952:0@lo:400:kworker.0 00000001:00100000:2.0:1787430737.138639:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24bdbdfb-c1b7-4700-ba76-999d38d57629 00000001:02000400:0.0:1787430737.835699:0:10320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787430737.949487:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787430738.182185:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24bdbdfb-c1b7-4700-ba76-999d38d57629 00000001:00100000:3.0:1787430738.185644:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24bdbdfb-c1b7-4700-ba76-999d38d57629 00010000:00010000:3.0:1787430738.972965:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430739.993299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430739.993452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430739.993485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430739.993540:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419264 00000100:00100000:0.0:1787430739.993551:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419264 00000100:00100000:0.0:1787430739.993618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 209 00000100:00100000:0.0:1787430739.993630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841419264:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430739.993709:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841419264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430739.993718:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 209 00000100:00100000:2.0:1787430739.993947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430739.994000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430739.994035:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419776 00000100:00100000:2.0:1787430739.994048:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419776 00000100:00100000:2.0:1787430739.994086:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419648 00000100:00100000:2.0:1787430739.994102:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419648 00000100:00100000:2.0:1787430739.994130:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:2.0:1787430739.994139:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841419776:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430739.994149:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:1.0:1787430739.994162:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841419648:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430739.994182:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841419776:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430739.994190:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:1.0:1787430739.994199:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841419648:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (197us total) trans 0 rc 0/0 00000100:00080000:2.0:1787430739.994209:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430739.994209:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00080000:2.0:1787430739.994215:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430739.994556:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419392 00000100:00100000:3.0:1787430739.994562:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419392 00000100:00100000:3.0:1787430739.994612:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419520 00000100:00100000:3.0:1787430739.994615:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419520 00000100:00100000:3.0:1787430739.994640:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:3.0:1787430739.994647:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841419392:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430739.994683:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841419392:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.994690:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:3.0:1787430739.994704:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787430739.994710:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841419520:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430739.994744:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841419520:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430739.994750:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00080000:2.0:1787430739.994829:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430739.996829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430741.020652:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430741.212701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430741.212726:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856126848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430741.212794:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430741.212852:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126848 00000100:00100000:0.0:1787430741.213032:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126848 00000100:00080000:2.0:1787430741.213124:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430741.213171:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787430741.213240:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856126848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430741.213277:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430741.213380:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856126848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430741.213388:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787430741.213511:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe632680 x1874256856126848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430741.213531:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856126848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787430742.044986:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430742.236587:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787430742.236670:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430742.236740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856126976 00000100:00100000:3.0:1787430742.236747:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856126976 00000100:00100000:3.0:1787430742.236790:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787430742.236799:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856126976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430742.236860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856126976:12345-0@lo:400:kworker.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430742.236867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787430742.236910:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856126976:0@lo:400:kworker.0 00000100:00100000:0.0:1787430742.236913:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856127104:0@lo:400:kworker.0 00000100:00100000:0.0:1787430742.236955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430742.237001:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127104 00000100:00100000:3.0:1787430742.237005:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127104 00000100:00100000:3.0:1787430742.237038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430742.237045:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856127104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430742.237083:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856127104:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430742.237089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430742.237113:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856127104:0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.237996:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856127360:0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.238038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430742.238071:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430742.238077:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856127488:0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.238097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430742.238510:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856127616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430742.238536:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430742.238556:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787430742.238574:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856127232:0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.238594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430742.238610:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856127744:0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.238628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430742.238652:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127616 00000100:00100000:1.0:1787430742.238658:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127616 00000100:00100000:1.0:1787430742.238698:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430742.238705:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856127616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430742.238732:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430742.238771:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856127616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.238777:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430742.238799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127488 00000100:00100000:1.0:1787430742.238803:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127488 00000100:00100000:1.0:1787430742.238836:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127232 00000100:00100000:1.0:1787430742.238840:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127232 00000100:00100000:0.0:1787430742.238842:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127360 00000100:00100000:0.0:1787430742.238845:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127360 00000100:00100000:1.0:1787430742.238861:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430742.238867:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856127488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430742.238867:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127744 00000100:00100000:0.0:1787430742.238870:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127744 00000100:00100000:0.0:1787430742.238886:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787430742.238892:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856127360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.238898:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856127488:12345-0@lo:400:kworker.0 Request processed in 32us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.238910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787430742.238920:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856127360:12345-0@lo:400:kworker.0 Request processed in 29us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.238922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787430742.238926:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430742.238927:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856127232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430742.238936:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430742.238953:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856127744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.238963:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856127232:12345-0@lo:400:kworker.0 Request processed in 36us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430742.238969:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787430742.238974:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856127744:12345-0@lo:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430742.238979:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787430742.238987:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787430742.238991:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430742.239050:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856127488:0@lo:400:kworker.0 00010000:00080000:1.0:1787430742.239062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe88aa00 x1874256856127360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430742.239072:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856127360:0@lo:400:kworker.0 00000100:00100000:1.0:1787430742.239101:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856127232:0@lo:400:kworker.0 00010000:00080000:1.0:1787430742.239111:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe88b480 x1874256856127744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430742.239119:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856127744:0@lo:400:kworker.0 00010000:00080000:1.0:1787430742.239127:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fdf80 x1874256856127616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430742.239139:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856127616:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787430743.070025:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430744.092498:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430745.113198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430745.113276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430745.113307:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430745.113349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430745.113373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430745.113400:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420032 00000100:00100000:0.0:1787430745.113410:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420032 00000100:00100000:0.0:1787430745.113516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420160 00000100:00100000:0.0:1787430745.113531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420160 00000100:00100000:0.0:1787430745.113560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:0.0:1787430745.113571:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841420032:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430745.113654:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841420032:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430745.113676:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:0.0:1787430745.113694:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:0.0:1787430745.113701:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841420160:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430745.113728:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841420160:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430745.113734:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:0.0:1787430745.113753:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420288 00000100:00100000:0.0:1787430745.113756:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420288 00000100:00100000:0.0:1787430745.113781:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420416 00000100:00100000:0.0:1787430745.113784:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420416 00000100:00100000:0.0:1787430745.113803:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:0.0:1787430745.113809:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841420288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430745.113835:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841420288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430745.113842:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:0.0:1787430745.113853:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:0.0:1787430745.113865:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841420416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430745.113898:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841420416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430745.113905:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00080000:0.0:1787430745.113924:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430745.113928:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430745.113930:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430745.114218:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841419904 00000100:00100000:2.0:1787430745.114225:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841419904 00000100:00100000:2.0:1787430745.114278:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 211 00000100:00100000:2.0:1787430745.114288:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841419904:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430745.114345:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841419904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 59us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430745.114352:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 211 00010000:00010000:3.0:1787430745.117156:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430746.141323:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430746.333837:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856127872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430746.333928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430746.334113:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856127872 00000100:00100000:1.0:1787430746.334121:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856127872 00000100:00100000:1.0:1787430746.334187:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787430746.334197:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856127872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430746.334237:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787430746.334300:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430746.337192:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856127872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2986us (3254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430746.337207:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787430746.337845:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fe300 x1874256856127872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430746.337880:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856127872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787430747.164829:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430747.356566:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856128128:0@lo:400:kworker.0 00000100:00100000:1.0:1787430747.356673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430747.356738:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856128640:0@lo:400:kworker.0 00000100:00100000:1.0:1787430747.356775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430747.356808:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430747.356814:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856128256:0@lo:400:kworker.0 00000100:00100000:1.0:1787430747.356833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430747.356875:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128128 00000100:00100000:1.0:1787430747.356882:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128128 00000100:00100000:1.0:1787430747.356922:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128256 00000100:00100000:2.0:1787430747.356924:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856128000:0@lo:400:kworker.0 00000100:00100000:1.0:1787430747.356926:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128256 00000100:00100000:1.0:1787430747.356956:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430747.356966:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856128128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430747.356985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430747.357026:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856128512:0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.357064:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856128384:0@lo:400:kworker.0 00000100:00100000:2.0:1787430747.357065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430747.357105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430747.357118:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128000 00000100:00100000:2.0:1787430747.357124:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128000 00000100:00100000:3.0:1787430747.357143:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128512 00000100:00100000:3.0:1787430747.357148:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128512 00000100:00100000:3.0:1787430747.357173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787430747.357179:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856128256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.357215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856128256:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430747.357221:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787430747.357236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787430747.357243:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856128512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430747.357279:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787430747.357284:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856128512:12345-0@lo:400:kworker.0 Request processed in 40us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430747.357294:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856128000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.357295:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430747.357430:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128640 00000100:00100000:0.0:1787430747.357434:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128640 00000100:00100000:0.0:1787430747.357464:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128384 00000100:00100000:0.0:1787430747.357467:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128384 00000100:00100000:0.0:1787430747.357488:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430747.357495:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856128640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.357560:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856128512:0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.357616:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787430747.357625:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856128384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430747.357870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856128000:12345-0@lo:400:kworker.0 Request processed in 582us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430747.357879:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:2.0:1787430747.357920:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430747.357925:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430747.357956:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856128000:0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.359676:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856128384:12345-0@lo:400:kworker.0 Request processed in 2049us (2566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430747.359687:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787430747.359753:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe888380 x1874256856128384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430747.359767:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856128384:0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.359859:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856128256:0@lo:400:kworker.0 00000100:00100000:3.0:1787430747.359870:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430747.359897:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856128768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430747.359937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430747.359973:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856128768 00000100:00100000:2.0:1787430747.359981:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856128768 00000100:00100000:2.0:1787430747.360029:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787430747.360040:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856128768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430747.360306:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856128128:12345-0@lo:400:kworker.0 Request processed in 3340us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430747.360316:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787430747.360405:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856128128:0@lo:400:kworker.0 00000100:00100000:0.0:1787430747.360598:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856128640:12345-0@lo:400:kworker.0 Request processed in 3103us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430747.360606:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787430747.360659:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe888700 x1874256856128640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430747.360669:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856128640:0@lo:400:kworker.0 00002000:00000024:2.0:1787430747.361192:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430747.361249:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856128768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1210us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430747.361271:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787430747.361286:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fce00 x1874256856128768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430747.361304:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856128768:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787430747.844723:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787430748.188560:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430749.215819:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787430749.833059:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff694e7b30 20000000:00000080:1.0:1787430749.833076:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f2fe063c00 uarg=0000000000000000 20000000:01000000:1.0:1787430749.833112:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787430749.833118:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787430749.833123:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787430749.834146:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787430749.834284:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787430749.840510:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787430749.840543:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840558:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840563:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840568:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840611:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840617:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840621:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840701:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840711:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 12 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.840722:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856128896:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430749.840881:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.840898:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.840906:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129024:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430749.840938:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841000:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 18 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.841011:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129152:0@lo:104: 00000100:00100000:1.0:1787430749.841049:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430749.841088:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841097:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 18 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.841105:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129280:0@lo:104: 00000100:00100000:1.0:1787430749.841126:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787430749.841154:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841162:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 18 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.841169:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129408:0@lo:104: 00000100:00100000:2.0:1787430749.841172:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129152 00000100:00100000:2.0:1787430749.841180:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129152 00000100:00100000:1.0:1787430749.841187:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430749.841210:0:11168:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c93ae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787430749.841215:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129280 00000100:00100000:2.0:1787430749.841218:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129280 00000100:00100000:1.0:1787430749.841245:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787430749.841255:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:11168:x1874256856129152:12345-0@lo:104: 00010000:00010000:1.0:1787430749.841268:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430749.841270:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129408 00000100:00100000:2.0:1787430749.841277:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129408 00000100:00100000:2.0:1787430749.841292:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787430749.841308:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:11168:x1874256856129280:12345-0@lo:104: 00010000:00010000:1.0:1787430749.841316:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787430749.841317:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.841321:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:11168:x1874256856129152:12345-0@lo:104: Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.841358:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787430749.841369:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787430749.841373:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:11168:x1874256856129280:12345-0@lo:104: Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.841374:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787430749.841380:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787430749.841380:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:11168:x1874256856129408:12345-0@lo:104: 00010000:00010000:1.0:1787430749.841388:0:8453:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841420:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787430749.841425:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+3:11168:x1874256856129408:12345-0@lo:104: Request processed in 45us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430749.841429:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430749.841526:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129152:0@lo:104: 00000100:00100000:1.0:1787430749.841535:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129280:0@lo:104: 00000100:00100000:1.0:1787430749.841542:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129408:0@lo:104: 00010000:00010000:1.0:1787430749.841560:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787430749.841565:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841584:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216ca00 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:2.0:1787430749.841592:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1787430749.841594:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841596:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841603:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0030e00 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:1.0:1787430749.841603:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430749.841606:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430749.841611:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841613:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430749.841618:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1787430749.841628:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430749.841633:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787430749.841643:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841648:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430749.841666:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841803:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030e00/0x1fa5b1e070e68db6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68dbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841817:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430749.841821:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.841822:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430749.841830:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430749.841833:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430749.841836:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856129664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430749.841837:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841842:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841848:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1787430749.841850:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430749.841855:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430749.841856:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841863:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f30216ca00/0x1fa5b1e070e68de0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841875:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430749.841875:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430749.841878:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430749.841881:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430749.841881:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430749.841885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430749.841901:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430749.841908:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856129536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430749.841909:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a800/0x1fa5b1e070e68d8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.841926:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430749.841928:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430749.841931:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430749.841936:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856129792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430749.841959:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430749.841995:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129664 00000100:00100000:3.0:1787430749.841999:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129664 00010000:00010000:3.0:1787430749.842018:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 19 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430749.842028:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129792 00000100:00100000:2.0:1787430749.842033:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129792 00000100:00100000:3.0:1787430749.842044:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787430749.842050:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 20 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430749.842056:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:839a7a74-1b4a-4cd3-9548-e5ffe194716c+20:3307:x1874256856129664:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430749.842065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430749.842071:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787430749.842076:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129536 00010000:00010000:3.0:1787430749.842080:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 20 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430749.842080:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129536 00010000:00010000:2.0:1787430749.842094:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 21 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.842101:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 21 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430749.842111:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787430749.842117:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0031200/0x1fa5b1e070e68dbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68db6 expref: 21 pid: 5831 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430749.842119:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+21:3309:x1874256856129792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430749.842127:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430749.842131:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 21 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.842149:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 20 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.842200:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430749.842225:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:839a7a74-1b4a-4cd3-9548-e5ffe194716c+20:3307:x1874256856129664:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.842230:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787430749.842259:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430749.842263:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856129536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430749.842268:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430749.842271:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 19 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.842276:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 19 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.842284:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68de0 expref: 19 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.842293:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430749.842930:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0031600/0x1fa5b1e070e68d93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68d8c expref: 18 pid: 5830 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.842940:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430749.842983:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:3309:x1874256856129792:12345-0@lo:103:ldlm_bl.0 Request processed in 864us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430749.842992:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787430749.843004:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3308:x1874256856129536:12345-0@lo:103:ldlm_bl.0 Request processed in 737us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.843012:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787430749.843115:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856129664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430749.843148:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856129792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430749.843413:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856129536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430749.843615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430749.843820:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420544 00000100:00100000:3.0:1787430749.843826:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420544 00010000:00010000:3.0:1787430749.843849:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 13 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430749.843894:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856128896:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430749.843904:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874256856129024:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430749.843925:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430749.843944:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:3.0:1787430749.843954:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841420544:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430749.843965:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430749.843970:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 13 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.843979:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 13 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.843991:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f30216d200/0x1fa5b1e070e68e11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144e3 expref: 13 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844001:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430749.844104:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:2374:x1874256841420544:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.844111:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:2.0:1787430749.844263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430749.844295:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420672 00000100:00100000:3.0:1787430749.844299:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420672 00010000:00010000:3.0:1787430749.844313:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430749.844357:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:3.0:1787430749.844373:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:2374:x1874256841420672:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430749.844381:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430749.844386:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844395:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844405:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68dfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144ab expref: 12 pid: 5832 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844416:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844424:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844438:0:8455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844445:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844452:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844459:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844465:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430749.844469:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844494:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844677:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430749.844688:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430749.844838:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.844847:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430749.844854:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4400/0x1fa5b1e070e68e2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430749.845133:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:2374:x1874256841420672:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 348us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430749.845141:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:2.0:1787430750.233250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430750.233292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430750.233398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430750.233449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430750.233482:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421184 00000100:00100000:2.0:1787430750.233493:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421184 00000100:00100000:2.0:1787430750.233581:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421056 00000100:00100000:2.0:1787430750.233586:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421056 00000100:00100000:2.0:1787430750.233611:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:2.0:1787430750.233622:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841421184:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430750.233699:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841421184:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430750.233706:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:2.0:1787430750.233723:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:2.0:1787430750.233730:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841421056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430750.233754:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841421056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430750.233761:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00080000:2.0:1787430750.233778:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430750.233795:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430750.233833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420800 00000100:00100000:3.0:1787430750.233839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420800 00000100:00100000:0.0:1787430750.233864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841420928 00000100:00100000:0.0:1787430750.233869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841420928 00000100:00100000:3.0:1787430750.233936:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:0.0:1787430750.233945:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00080000:1.0:1787430750.233949:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430750.233955:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841420928:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430750.233956:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841420800:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430750.234001:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841420800:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 57us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430750.234004:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841420928:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 52us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430750.234008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:0.0:1787430750.234011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 52 00010000:00010000:3.0:1787430750.236515:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430751.260424:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430751.452531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430751.452553:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856129920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430751.452617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430751.452781:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856129920 00000100:00100000:0.0:1787430751.452789:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856129920 00000100:00100000:0.0:1787430751.452849:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430751.452857:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856129920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430751.452889:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430751.452929:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856129920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430751.452936:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787430751.452990:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787430751.453020:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fd880 x1874256856129920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430751.453038:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856129920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430751.515064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430751.515106:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421312 00000100:00100000:3.0:1787430751.515116:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421312 00000100:00100000:3.0:1787430751.515166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 213 00000100:00100000:3.0:1787430751.515176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:5607:x1874256841421312:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430751.515193:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430751.515212:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1450d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.515253:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.515265:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.515275:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430751.515346:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841421312:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 151us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.515355:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 213 00000100:00100000:3.0:1787430751.521524:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430751.521610:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421440 00000100:00100000:0.0:1787430751.521619:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421440 00000100:00100000:0.0:1787430751.521676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 214 00000100:00100000:0.0:1787430751.521686:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841421440:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430751.521974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841421440:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 288us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430751.521983:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 214 00000100:00100000:0.0:1787430751.528984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430751.529097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421568 00000100:00100000:3.0:1787430751.529109:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421568 00000100:00100000:3.0:1787430751.529172:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00100000:3.0:1787430751.529184:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841421568:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.529438:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841421568:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 256us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.529447:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00100000:3.0:1787430751.534596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430751.534702:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421696 00000100:00100000:0.0:1787430751.534713:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421696 00000100:00100000:0.0:1787430751.534778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00100000:0.0:1787430751.534789:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841421696:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430751.534807:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430751.534826:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14514 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430751.534855:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430751.534867:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430751.534878:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216ce00, rc 0) 00000100:00100000:0.0:1787430751.534932:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841421696:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430751.534940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00100000:3.0:1787430751.537986:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430751.538244:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421824 00000100:00100000:0.0:1787430751.538255:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421824 00000100:00100000:0.0:1787430751.538359:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00100000:0.0:1787430751.538372:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841421824:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430751.538676:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841421824:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 306us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430751.538685:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00100000:3.0:1787430751.541142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430751.541176:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841421952 00000100:00100000:3.0:1787430751.541185:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841421952 00000100:00100000:3.0:1787430751.541230:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 218 00000100:00100000:3.0:1787430751.541241:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841421952:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.541475:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841421952:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 236us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.541483:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 218 10000000:01000000:1.0:1787430751.772386:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787430751.772394:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c4de8800 from 7 10000000:01000000:1.0:1787430751.772398:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787430751.772454:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430751.772466:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430751.772478:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430751.772504:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787430751.772579:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430751.772639:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430751.773250:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130048 00000100:00100000:3.0:1787430751.773259:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130048 00000100:00100000:3.0:1787430751.773343:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787430751.773355:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856130048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430751.773368:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430751.773380:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68e42 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.773403:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.773412:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.773427:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a000, rc 0) 00000100:00100000:3.0:1787430751.773483:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856130048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.773489:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787430751.773711:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430751.773727:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430751.773737:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430751.773802:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430751.773829:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430751.773856:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430751.774000:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130176 00000100:00100000:2.0:1787430751.774005:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130176 00000100:00100000:2.0:1787430751.774042:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787430751.774051:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856130176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430751.774311:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856130176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430751.774342:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787430751.774403:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.774432:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.774481:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430751.774516:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430751.774567:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130304 00000100:00100000:2.0:1787430751.774572:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130304 00000100:00100000:3.0:1787430751.774659:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787430751.774675:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856130304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.774915:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856130304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.774923:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787430751.774981:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430751.776046:0:11325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787430751.776228:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787430751.776265:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430751.776275:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430751.776285:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430751.776295:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787430751.776297:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2c562b800 from 7 10000000:01000000:2.0:1787430751.776300:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430751.776440:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430751.776449:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430751.776459:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430751.776559:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c66e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.776616:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430751.776693:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c619c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430751.776728:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130432 00000100:00100000:2.0:1787430751.776735:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130432 00000100:00100000:2.0:1787430751.776935:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787430751.776947:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856130432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430751.776961:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430751.776981:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68e50 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430751.777003:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430751.777014:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430751.777022:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75800, rc 0) 00000100:00100000:2.0:1787430751.777066:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856130432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430751.777072:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787430751.777135:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c66e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430751.777151:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.777159:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430751.777209:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.777242:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430751.777262:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c619c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430751.777276:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130560 00000100:00100000:3.0:1787430751.777280:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130560 00000100:00100000:3.0:1787430751.777309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787430751.777315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856130560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.777564:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856130560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.777578:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787430751.777611:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.777644:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.777684:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430751.777705:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c619c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430751.777716:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130688 00000100:00100000:3.0:1787430751.777719:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130688 00000100:00100000:3.0:1787430751.777739:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787430751.777745:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856130688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.777894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856130688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.777901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787430751.777939:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787430751.779585:0:11326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787430751.779713:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787430751.779734:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430751.779745:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.779815:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430751.779827:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430751.779830:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2d0492800 from 7 10000000:01000000:3.0:1787430751.779833:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430751.779865:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.779873:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.779897:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430751.779918:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.779975:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430751.780022:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130816 00000100:00100000:3.0:1787430751.780024:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430751.780030:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130816 00000100:00100000:1.0:1787430751.780075:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787430751.780085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856130816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430751.780097:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430751.780116:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68e5e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430751.780249:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430751.780261:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430751.780270:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4600, rc 0) 00000100:00100000:1.0:1787430751.780319:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856130816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430751.780356:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787430751.780476:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430751.780490:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.780499:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430751.780544:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.780569:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430751.780633:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430751.780661:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856130944 00000100:00100000:2.0:1787430751.780666:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856130944 00000100:00100000:2.0:1787430751.780726:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787430751.780735:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856130944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430751.780995:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856130944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430751.781002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787430751.781065:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec135500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856130944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430751.781095:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856131072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430751.781148:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430751.781419:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430751.781473:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131072 00000100:00100000:3.0:1787430751.781478:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131072 00000100:00100000:3.0:1787430751.781503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787430751.781510:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856131072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430751.781658:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856131072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430751.781665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787430751.781705:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856131072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787430751.782471:0:11327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787430751.782531:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787430751.782544:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430751.782553:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430751.782565:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1787430751.987211:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787430752.284625:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430752.476574:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856131584:0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.476588:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856131200:0@lo:400:kworker.0 00000100:00100000:2.0:1787430752.476707:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856131328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430752.477178:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856131456:0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.478028:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430752.478100:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856131712:0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.478134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430752.478177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131200 00000100:00100000:1.0:1787430752.478185:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131200 00000100:00100000:1.0:1787430752.478233:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787430752.478243:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856131200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.478297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2db159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856131200:12345-0@lo:400:kworker.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430752.478322:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787430752.478375:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131712 00000100:00100000:1.0:1787430752.478380:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131712 00000100:00100000:1.0:1787430752.478409:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787430752.478415:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856131712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.478449:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856131712:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430752.478455:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787430752.478491:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec137b80 x1874256856131712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430752.478507:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856131712:0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.478518:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856131200:0@lo:400:kworker.0 00000100:00100000:2.0:1787430752.479191:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430752.479228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430752.479268:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430752.479277:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856131968:0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.479290:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131328 00000100:00100000:1.0:1787430752.479295:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131328 00000100:00100000:1.0:1787430752.479348:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430752.479356:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856131328:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787430752.479371:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787430752.479385:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430752.479434:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856131328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430752.479441:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787430752.479463:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fed80 x1874256856131328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430752.479463:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131584 00000100:00100000:1.0:1787430752.479469:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131584 00000100:00100000:2.0:1787430752.479486:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856131328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430752.479489:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430752.479509:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430752.479518:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856131584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787430752.479520:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430752.479568:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856131584:12345-0@lo:400:kworker.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430752.479570:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131968 00000100:00100000:0.0:1787430752.479576:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131968 00000100:00100000:1.0:1787430752.479585:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430752.479620:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856131584:0@lo:400:kworker.0 00000100:00100000:0.0:1787430752.479685:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430752.479694:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856131968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430752.479749:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856131968:12345-0@lo:400:kworker.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430752.479756:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787430752.479796:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec135c00 x1874256856131968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430752.479806:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856131968:0@lo:400:kworker.0 00000100:00100000:2.0:1787430752.480474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430752.480507:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856131840:0@lo:400:kworker.0 00000100:00100000:2.0:1787430752.480531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430752.480608:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131456 00000100:00100000:0.0:1787430752.480614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131456 00000100:00100000:0.0:1787430752.480644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856131840 00000100:00100000:0.0:1787430752.480647:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856131840 00000100:00100000:0.0:1787430752.480671:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787430752.480713:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430752.480868:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787430752.480872:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856131456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430752.480882:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856131840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430752.480922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856131456:12345-0@lo:400:kworker.0 Request processed in 55us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430752.480933:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787430752.480934:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856131840:12345-0@lo:400:kworker.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430752.480943:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787430752.480969:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856131456:0@lo:400:kworker.0 00000100:00100000:0.0:1787430752.480981:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856131840:0@lo:400:kworker.0 00010000:00010000:3.0:1787430753.309084:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430754.333426:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787430754.367177:0:11465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:32:33 (1787430753) === 00000100:00100000:1.0:1787430754.514976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430754.515299:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841422080 00000100:00100000:0.0:1787430754.515310:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841422080 00000100:00100000:0.0:1787430754.515615:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:0.0:1787430754.515627:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:9672:x1874256841422080:12345-192.168.204.60@tcp:700:mkdir.0 00000100:00100000:0.0:1787430754.515721:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:9672:x1874256841422080:12345-192.168.204.60@tcp:700:mkdir.0 Request processed in 97us (754us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430754.515730:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430754.515731:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:3.0:1787430754.518454:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.518583:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841422336 00000100:00100000:1.0:1787430754.518594:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841422336 00000100:00100000:1.0:1787430754.518645:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:1.0:1787430754.518654:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:9672:x1874256841422336:12345-192.168.204.60@tcp:36:mkdir.0 00010000:00010000:1.0:1787430754.518723:0:9043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430754.518801:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e68d4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14496 expref: 6 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.518834:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:1.0:1787430754.518845:0:9043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430754.519145:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.519157:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.519177:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.519206:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.519213:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.519219:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430754.520887:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787430754.520904:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.520913:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.520920:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.520925:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.520930:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.520937:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.520950:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5300) 00010000:00010000:1.0:1787430754.520953:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430754.520966:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.520971:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430754.521997:0:9043:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2b1b588 reply state 00000000e6fc87ec transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430754.522008:0:9043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430754.522157:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9672:x1874256841422336:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 3499us (3706us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787430754.522167:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00010000:00010000:2.0:1787430754.525107:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.525199:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.525208:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.525215:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430754.525220:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.525236:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.525255:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0f2d0ce5100) 00010000:00010000:2.0:1787430754.525259:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430754.525263:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.525269:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68e73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430754.534841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.535279:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841422464 00000100:00100000:1.0:1787430754.535289:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841422464 00000100:00100000:1.0:1787430754.535369:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787430754.535379:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:9673:x1874256841422464:12345-192.168.204.60@tcp:101:chmod.0 00010000:00010000:1.0:1787430754.535399:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430754.535420:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1451b expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.535498:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.535512:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.535522:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430754.535584:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787430754.535601:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430754.535648:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.535689:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1451b expref: 8 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.535715:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1451b expref: 7 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.535724:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5300) 00010000:00010000:1.0:1787430754.535727:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430754.535729:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5e00, rc 0) 00000100:00100000:1.0:1787430754.535792:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9673:x1874256841422464:12345-192.168.204.60@tcp:101:chmod.0 Request processed in 414us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.535800:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430754.539598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430754.539668:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841422720 00000100:00100000:2.0:1787430754.539683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841422720 00000100:00100000:2.0:1787430754.539901:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:2.0:1787430754.539913:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9673:x1874256841422720:12345-192.168.204.60@tcp:36:chmod.0 00010000:00010000:2.0:1787430754.539969:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430754.539994:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1451b expref: 7 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.540013:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5300) 00010000:00010000:2.0:1787430754.540023:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430754.540048:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.540060:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.540070:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430754.540414:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edd4de74 reply state 00000000db0c552b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430754.540424:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787430754.540517:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787430754.540707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:9673:x1874256841422720:12345-192.168.204.60@tcp:36:chmod.0 Request processed in 784us (1108us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787430754.540718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00010000:00010000:0.0:1787430754.543469:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430754.543486:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430754.543494:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430754.543500:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430754.543505:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430754.543513:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430754.543531:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d22f0c00) 00010000:00010000:0.0:1787430754.543534:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787430754.543538:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430754.543544:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68e88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430754.559089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.559219:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841422848 00000100:00100000:1.0:1787430754.559230:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841422848 00000100:00100000:1.0:1787430754.559300:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:1.0:1787430754.559311:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9674:x1874256841422848:12345-192.168.204.60@tcp:101:chown.0 00010000:00010000:1.0:1787430754.559382:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430754.559405:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14522 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.559479:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e68e96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.559495:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e68e96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.559521:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e68e96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430754.559585:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787430754.559590:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430754.559637:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e68e96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.559666:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14522 expref: 9 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.559682:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e68e96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14522 expref: 8 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.559691:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430754.559706:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430754.559710:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4800, rc 0) 00000100:00100000:1.0:1787430754.559816:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:9674:x1874256841422848:12345-192.168.204.60@tcp:101:chown.0 Request processed in 506us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.559823:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:2.0:1787430754.562765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430754.562860:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841422976 00000100:00100000:3.0:1787430754.562870:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841422976 00000100:00100000:3.0:1787430754.562935:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:3.0:1787430754.562945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:9674:x1874256841422976:12345-192.168.204.60@tcp:101:chown.0 00010000:00010000:3.0:1787430754.562963:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430754.562983:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e68e9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14529 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563045:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563064:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563086:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563099:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563107:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563113:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563217:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e68eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563226:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e68eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563232:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e68eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430754.563267:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787430754.563271:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430754.563294:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e68eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563305:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563311:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563356:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563363:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430754.563367:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563375:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563386:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:3.0:1787430754.563389:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430754.563393:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563400:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563413:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563420:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563428:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563433:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430754.563436:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563449:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563457:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0f2daf05200) 00010000:00010000:3.0:1787430754.563459:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430754.563462:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563468:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68eab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563496:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e68e9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14529 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563508:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e68eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14529 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.563515:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2daf05900) 00010000:00010000:3.0:1787430754.563517:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430754.563519:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:2.0:1787430754.564211:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:9674:x1874256841422976:12345-192.168.204.60@tcp:101:chown.0 Request processed in 1264us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430754.564220:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:3.0:1787430754.566853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430754.567057:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841423232 00000100:00100000:2.0:1787430754.567067:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841423232 00000100:00100000:2.0:1787430754.567120:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:2.0:1787430754.567130:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:9674:x1874256841423232:12345-192.168.204.60@tcp:36:chown.0 00010000:00010000:2.0:1787430754.567184:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430754.567208:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e68eb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14529 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.567228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2daf05900) 00010000:00010000:2.0:1787430754.567237:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430754.567264:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.567276:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.567285:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430754.599460:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc4fcc6b reply state 000000001d56b146 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430754.599477:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787430754.599639:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1787430754.599651:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00200000:2.0:1787430754.600618:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787430754.601130:0:5839:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787430754.601170:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9674:x1874256841423232:12345-192.168.204.60@tcp:36:chown.0 Request processed in 34024us (34308us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787430754.601191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00010000:00010000:3.0:1787430754.601286:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.601297:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.601306:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.601324:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430754.601346:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.601355:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.601375:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d22f0900) 00010000:00010000:3.0:1787430754.601378:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787430754.601383:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.601390:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68eb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430754.618150:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430754.621366:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841423360 00000100:00100000:2.0:1787430754.621382:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841423360 00000100:00100000:2.0:1787430754.621626:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:2.0:1787430754.621637:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:9675:x1874256841423360:12345-192.168.204.60@tcp:101:touch.500 00010000:00010000:2.0:1787430754.621664:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430754.621686:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e68ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14530 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430754.622484:0:6884:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 733us 00010000:00010000:1.0:1787430754.632485:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.632506:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.632518:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.632543:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.632550:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.632556:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633028:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e68ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633039:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e68ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633046:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e68ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430754.633123:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787430754.633128:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430754.633224:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e68ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633238:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633245:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633268:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633285:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.633290:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633298:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633313:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430754.633316:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430754.633321:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633354:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633366:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633372:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633378:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633383:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.633386:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633392:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633411:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430754.633413:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430754.633416:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633422:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68ece lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633461:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e68ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14530 expref: 8 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633476:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e68ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14530 expref: 7 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.633483:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430754.633486:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430754.633494:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5600, rc 0) 00000100:00100000:1.0:1787430754.633568:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9675:x1874256841423360:12345-192.168.204.60@tcp:101:touch.500 Request processed in 11931us (15428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.633579:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:2.0:1787430754.642941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430754.643025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841423616 00000100:00100000:3.0:1787430754.643036:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841423616 00000100:00100000:3.0:1787430754.643151:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:3.0:1787430754.643162:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9675:x1874256841423616:12345-192.168.204.60@tcp:101:touch.500 00010000:00010000:3.0:1787430754.643183:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430754.643204:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e68edc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14537 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.643813:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.643830:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.643852:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.643869:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.643876:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.643883:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430754.644979:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787430754.645245:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645462:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645540:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645580:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645586:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645592:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645598:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430754.645608:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645614:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645626:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:3.0:1787430754.645629:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430754.645633:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645639:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68ee3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430754.645651:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f840532 reply state 000000001f19eb6c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430754.645659:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787430754.645704:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e68edc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14537 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645719:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14537 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.645725:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2daf05200) 00010000:00010000:3.0:1787430754.645728:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430754.645730:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147be00, rc 0) 00000100:00100000:3.0:1787430754.645840:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:9675:x1874256841423616:12345-192.168.204.60@tcp:101:touch.500 Request processed in 2678us (2906us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787430754.645849:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00010000:00010000:3.0:1787430754.647414:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.647425:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.647430:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.647434:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430754.647436:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.647440:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.647450:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430754.647452:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430754.647454:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.647457:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e68eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430754.651458:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430754.651586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841423872 00000100:00100000:3.0:1787430754.651634:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841423872 00000100:00100000:3.0:1787430754.651712:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787430754.651724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:9675:x1874256841423872:12345-192.168.204.60@tcp:36:touch.500 00010000:00010000:3.0:1787430754.651802:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430754.651829:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14537 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.651867:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2daf05200) 00010000:00010000:3.0:1787430754.651879:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430754.651930:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.651944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.651954:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430754.652074:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7018f30 reply state 00000000c00680cb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430754.652081:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430754.652163:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:9675:x1874256841423872:12345-192.168.204.60@tcp:36:touch.500 Request processed in 442us (715us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787430754.652171:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:0.0:1787430754.654919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.655168:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841424000 00000100:00100000:1.0:1787430754.655177:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841424000 00010000:00010000:2.0:1787430754.655198:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.655208:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.655215:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.655220:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430754.655225:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.655232:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430754.655243:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00010000:00010000:2.0:1787430754.655247:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2daf05900) 00000100:00100000:1.0:1787430754.655261:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:9675:x1874256841424000:12345-192.168.204.60@tcp:101:touch.500 00010000:00010000:2.0:1787430754.655263:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430754.655268:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.655274:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e68eff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.655285:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430754.655378:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1453e expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.655585:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1453e expref: 10 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.655599:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1453e expref: 10 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.655620:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430754.655622:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430754.655624:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4400, rc 0) 00000100:00100000:1.0:1787430754.655734:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:9675:x1874256841424000:12345-192.168.204.60@tcp:101:touch.500 Request processed in 482us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.655741:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:0.0:1787430754.661978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.662135:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841424128 00000100:00100000:1.0:1787430754.662146:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841424128 00000100:00100000:1.0:1787430754.662198:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:1.0:1787430754.662207:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2370:x1874256841424128:12345-192.168.204.60@tcp:8:touch.500 00010000:00080000:1.0:1787430754.662241:0:8633:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1787430754.662275:0:8633:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e68f0d 00002000:00100000:1.0:1787430754.662287:0:8633:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 711a801a-27eb-4d09-8ae0-8dc5ece71a10/ffffa0f2ec26a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787430754.662320:0:8633:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787430754.662596:0:8633:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787430754.662626:0:8633:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec26d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430754.662998:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841424128:12345-192.168.204.60@tcp:8:touch.500 Request processed in 788us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.663023:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:2.0:1787430754.665151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430754.665260:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841424256 00000100:00100000:0.0:1787430754.665270:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841424256 00000100:00100000:0.0:1787430754.665481:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:0.0:1787430754.665493:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:0:x1874256841424256:12345-192.168.204.60@tcp:2:touch.500 00000100:00080000:1.0:1787430754.665893:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787430754.694782:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787430754.694800:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000100:00100000:0.0:1787430754.694973:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:0:x1874256841424256:12345-192.168.204.60@tcp:2:touch.500 Request processed in 29476us (29825us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787430754.694985:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:0.0:1787430754.698079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.698244:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841424512 00000100:00100000:1.0:1787430754.698254:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841424512 00000100:00100000:1.0:1787430754.698312:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:1.0:1787430754.698363:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:9675:x1874256841424512:12345-192.168.204.60@tcp:35:touch.500 00000100:00100000:1.0:1787430754.698752:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:9675:x1874256841424512:12345-192.168.204.60@tcp:35:touch.500 Request processed in 429us (682us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787430754.698761:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:3.0:1787430754.717267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430754.718457:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841424640 00000100:00100000:2.0:1787430754.718469:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841424640 00000100:00100000:2.0:1787430754.718547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:2.0:1787430754.718559:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:9676:x1874256841424640:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787430754.718584:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430754.718617:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e68f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14545 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.718707:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.718721:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.718732:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430754.718798:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787430754.718802:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430754.718851:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.718880:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e68f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14545 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.718914:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14545 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.718923:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:2.0:1787430754.718926:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430754.718929:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75600, rc 0) 00000100:00100000:2.0:1787430754.719005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:9676:x1874256841424640:12345-192.168.204.60@tcp:101:rm.0 Request processed in 448us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430754.719012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:2.0:1787430754.724055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430754.724255:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841424896 00000100:00100000:3.0:1787430754.724265:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841424896 00000100:00100000:3.0:1787430754.724366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:3.0:1787430754.724378:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:9676:x1874256841424896:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787430754.724398:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430754.724420:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68f22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1454c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430754.724591:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787430754.724740:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68f22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1454c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.724755:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:3.0:1787430754.724758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430754.724764:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147be00/0x1fa5b1e070e68f22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1454c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.724778:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147be00, rc 0) 00000100:00100000:3.0:1787430754.724830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:9676:x1874256841424896:12345-192.168.204.60@tcp:101:rm.0 Request processed in 455us (785us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787430754.724838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:0.0:1787430754.732633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430754.734831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841425024 00000100:00100000:2.0:1787430754.734845:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841425024 00000100:00100000:2.0:1787430754.734910:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:2.0:1787430754.734920:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:9676:x1874256841425024:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:2.0:1787430754.739184:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:9676:x1874256841425024:12345-192.168.204.60@tcp:37:rm.0 Request processed in 4254us (6548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430754.739197:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:3.0:1787430754.744679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.744773:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841425280 00000100:00100000:1.0:1787430754.744786:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841425280 00000100:00100000:1.0:1787430754.744860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:1.0:1787430754.744872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:9676:x1874256841425280:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:1.0:1787430754.745415:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:9676:x1874256841425280:12345-192.168.204.60@tcp:35:rm.0 Request processed in 543us (748us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787430754.745424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:0.0:1787430754.748699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.749524:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841425536 00000100:00100000:1.0:1787430754.749538:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841425536 00000100:00100000:1.0:1787430754.749674:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:1.0:1787430754.749687:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:9676:x1874256841425536:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787430754.749728:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430754.750022:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14553 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.750180:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68f37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.750214:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.750225:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430754.750238:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787430754.750406:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14553 expref: 17 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.750429:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68f37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14553 expref: 16 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.750438:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430754.750441:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430754.750446:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5000, rc 0) 00000100:00100000:1.0:1787430754.750531:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841425536:12345-192.168.204.60@tcp:101:rm.0 Request processed in 847us (1855us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787430754.750539:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:0.0:1787430754.753638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.754124:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841425664 00000100:00100000:1.0:1787430754.754137:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841425664 00000100:00100000:1.0:1787430754.754254:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:1.0:1787430754.754268:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841425664:12345-192.168.204.60@tcp:41:rm.0 00000004:00000024:1.0:1787430754.754382:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787430754.754469:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841425664:12345-192.168.204.60@tcp:41:rm.0 Request processed in 204us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430754.754477:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:2.0:1787430754.757151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430754.758845:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841425792 00000100:00100000:3.0:1787430754.758861:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841425792 00000100:00100000:2.0:1787430754.759181:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:2.0:1787430754.759198:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841425792:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787430754.759225:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430754.759253:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e68f45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1455a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759371:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759403:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759416:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759435:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759442:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759449:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759584:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759593:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759600:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430754.759631:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787430754.759635:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430754.759656:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759669:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759688:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759707:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759714:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759720:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430754.759725:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759733:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759871:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:2.0:1787430754.759875:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430754.759881:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759887:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e68f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759904:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759910:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.759916:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760133:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430754.760138:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760145:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760154:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffffa0f2d22f0400) 00010000:00010000:2.0:1787430754.760157:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430754.760160:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760167:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e68f53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760209:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e68f45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1455a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760224:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1455a expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.760232:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:2.0:1787430754.760235:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430754.760237:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75400, rc 0) 00000100:00100000:2.0:1787430754.760424:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:9676:x1874256841425792:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1230us (3285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430754.760433:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:0.0:1787430754.765517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.765574:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841426048 00000100:00100000:1.0:1787430754.765587:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841426048 00000100:00100000:1.0:1787430754.765661:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:1.0:1787430754.765674:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:9676:x1874256841426048:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787430754.765753:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787430754.765788:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e68f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1455a expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765813:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1453e expref: 16 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765828:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430754.765846:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e68f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14545 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765854:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430754.765858:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430754.765883:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765901:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765912:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765928:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.765935:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.766088:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.766243:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.766251:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.766260:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430754.767298:0:6884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787430754.767314:0:6884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 218321986299ns, next at 219321983470ns, rc = 0 00010000:00010000:1.0:1787430754.767425:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767438:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767449:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767458:0:6884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767466:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767474:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767515:0:6884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430754.767538:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767546:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767553:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767559:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.767565:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767575:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767589:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430754.767592:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787430754.767597:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767604:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767625:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767632:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767638:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767650:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.767653:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767660:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767668:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430754.767671:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430754.767674:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.767680:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430754.767699:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000244192ea reply state 00000000f884c627 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430754.767709:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430754.767822:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841426048:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2147us (2318us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787430754.767831:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00010000:00010000:2.0:1787430754.767926:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430754.767939:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.767945:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430754.767949:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.767955:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.768030:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430754.768033:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787430754.768036:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.768042:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e68f76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.768058:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430754.768060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430754.768062:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430754.771049:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.771070:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.771079:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.771085:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430754.771091:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.771121:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.771140:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffffa0f2d0ce5400) 00010000:00010000:3.0:1787430754.771143:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430754.771148:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430754.771155:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e68f68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430754.773300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430754.773505:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841426304 00000100:00100000:2.0:1787430754.773528:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841426304 00000100:00100000:2.0:1787430754.773596:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787430754.773609:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:9676:x1874256841426304:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787430754.774139:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841426304:12345-192.168.204.60@tcp:35:rm.0 Request processed in 531us (852us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787430754.774149:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:0.0:1787430754.779554:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430754.779666:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841426560 00000100:00100000:1.0:1787430754.779681:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841426560 00000100:00100000:1.0:1787430754.779770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:1.0:1787430754.779783:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:9676:x1874256841426560:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787430754.779882:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787430754.780038:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e68f37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14553 expref: 16 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780089:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e68ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14530 expref: 15 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780103:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430754.780121:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e68e96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14522 expref: 14 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780130:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430754.780138:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430754.780168:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780184:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780193:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780207:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780214:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.780221:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.781544:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.781575:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.781587:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430754.782417:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787430754.782440:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782450:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782459:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782466:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.782472:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782481:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782496:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0f2d0ce5e00) 00010000:00010000:1.0:1787430754.782500:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787430754.782504:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782511:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e68f8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782540:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782554:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782560:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782566:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430754.782569:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782575:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782583:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430754.782586:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430754.782589:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430754.782595:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e68f7d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430754.782610:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dfe3206 reply state 000000003ff55a9c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430754.782621:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430754.782755:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:9676:x1874256841426560:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2969us (3213us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787430754.782766:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00010000:00010000:2.0:1787430754.784864:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.784901:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.784907:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.784911:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430754.784915:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.784921:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.784935:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0f2d0ce5800) 00010000:00010000:2.0:1787430754.784937:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430754.784940:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430754.784945:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e68f84 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430755.355801:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430755.355846:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430755.355885:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841426688 00000100:00100000:0.0:1787430755.355891:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430755.355896:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841426688 00000100:00100000:1.0:1787430755.355978:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 229 00000100:00100000:1.0:1787430755.355989:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841426688:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430755.355997:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841426944 00000100:00100000:2.0:1787430755.356003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841426944 00000100:00100000:2.0:1787430755.356055:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:1.0:1787430755.356064:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c6076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841426688:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430755.356066:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841426944:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430755.356079:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 229 00000100:00100000:2.0:1787430755.356111:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841426944:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430755.356113:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430755.356122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00010000:00010000:2.0:1787430755.356576:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430755.356986:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841426816 00000100:00100000:3.0:1787430755.356991:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841426816 00000100:00100000:3.0:1787430755.357077:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:3.0:1787430755.357087:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841426816:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430755.357142:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841426816:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 57us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430755.357149:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:3.0:1787430755.365369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430755.365426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430755.365752:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427072 00000100:00100000:2.0:1787430755.365765:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427072 00000100:00100000:1.0:1787430755.365915:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427200 00000100:00100000:1.0:1787430755.365930:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427200 00000100:00100000:2.0:1787430755.366033:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:2.0:1787430755.366048:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2370:x1874256841427072:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:2.0:1787430755.366089:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68e1f 00000100:00080000:2.0:1787430755.366101:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec106000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430755.366170:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787430755.366664:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+2:2370:x1874256841427072:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 617us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430755.366675:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00010000:00010000:2.0:1787430755.366739:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430755.371468:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:1.0:1787430755.371490:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2370:x1874256841427200:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:1.0:1787430755.371530:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68e26 00000100:00080000:1.0:1787430755.371543:0:6686:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec105800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787430755.372140:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430755.372147:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787430755.372968:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787430755.373232:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787430755.375412:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+2:2370:x1874256841427200:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 3917us (9970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430755.375479:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00010000:00010000:2.0:1787430756.380493:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430756.572906:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430756.572932:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856132096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430756.573012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430756.573186:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132096 00000100:00100000:0.0:1787430756.573196:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132096 00000100:00100000:0.0:1787430756.573264:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430756.573274:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856132096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430756.573312:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787430756.573446:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430756.573738:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856132096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 463us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430756.574077:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787430756.574714:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fce00 x1874256856132096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430756.574739:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856132096:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787430757.154907:0:11616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787430757.408059:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430757.596610:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856132224:0@lo:400:kworker.0 00000100:00100000:1.0:1787430757.596658:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856132480:0@lo:400:kworker.0 00000100:00100000:0.0:1787430757.596698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430757.596713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430757.596777:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856132352:0@lo:400:kworker.0 00000100:00100000:2.0:1787430757.596807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430757.596818:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430757.596827:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856132608:0@lo:400:kworker.0 00000100:00100000:2.0:1787430757.596830:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856132864:0@lo:400:kworker.0 00000100:00100000:1.0:1787430757.596861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430757.596894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430757.596902:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132224 00000100:00100000:1.0:1787430757.596908:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132224 00000100:00100000:2.0:1787430757.596919:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430757.596926:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856132736:0@lo:400:kworker.0 00000100:00100000:2.0:1787430757.596950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430757.596956:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787430757.596971:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856132224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430757.596977:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132608 00000100:00100000:2.0:1787430757.596982:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132608 00000100:00100000:2.0:1787430757.597010:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132864 00000100:00100000:2.0:1787430757.597013:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132864 00000100:00100000:1.0:1787430757.597020:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856132224:12345-0@lo:400:kworker.0 Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430757.597033:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787430757.597054:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787430757.597061:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132480 00000100:00100000:2.0:1787430757.597063:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856132608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430757.597071:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132352 00000100:00100000:3.0:1787430757.597074:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132480 00000100:00100000:1.0:1787430757.597078:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132352 00000100:00100000:1.0:1787430757.597113:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132736 00000100:00100000:1.0:1787430757.597117:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132736 00000100:00100000:3.0:1787430757.597134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787430757.597146:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856132224:0@lo:400:kworker.0 00000100:00100000:3.0:1787430757.597150:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856132352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430757.597153:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430757.597166:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856132480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430757.597195:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787430757.597206:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856132736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430757.597222:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856132480:12345-0@lo:400:kworker.0 Request processed in 57us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430757.597227:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856132352:12345-0@lo:400:kworker.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430757.597237:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430757.597244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787430757.597248:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856132736:12345-0@lo:400:kworker.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430757.597257:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787430757.597269:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787430757.597275:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430757.597280:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c34f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856132864:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787430757.597282:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787430757.597314:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2feb3df80 x1874256856132608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430757.597361:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856132608:0@lo:400:kworker.0 00000100:00100000:2.0:1787430757.597370:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856132608:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430757.597376:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856132736:0@lo:400:kworker.0 00000100:00100000:2.0:1787430757.597382:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787430757.597515:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856132480:0@lo:400:kworker.0 00000100:00100000:3.0:1787430757.597523:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856132352:0@lo:400:kworker.0 00000100:00100000:1.0:1787430757.597529:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c34f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856132864:12345-0@lo:400:kworker.0 Request processed in 248us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430757.597538:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787430757.597543:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2feb3dc00 x1874256856132864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430757.597555:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856132864:0@lo:400:kworker.0 00000004:00080000:0.0:1787430757.597581:0:8170:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 221152253049ns, next at 222152249975ns, rc = 0 00000100:00100000:2.0:1787430757.597583:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856132992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430757.597613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430757.597654:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856132992 00000100:00100000:0.0:1787430757.597658:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856132992 00000100:00100000:0.0:1787430757.597686:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430757.597693:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856132992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430757.597719:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430757.597876:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856132992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430757.597882:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787430757.598316:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fe300 x1874256856132992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430757.598370:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856132992:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787430757.620359:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24bdbdfb-c1b7-4700-ba76-999d38d57629 00000020:00000080:3.0:1787430757.620368:0:6708:0:(genops.c:885:class_export_put()) final put ffffa0f2ec100800/24bdbdfb-c1b7-4700-ba76-999d38d57629 00000020:00000080:2.0:1787430757.620539:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec100800/24bdbdfb-c1b7-4700-ba76-999d38d57629 for lustre-OST0000 00000020:00000080:2.0:1787430757.620594:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2ec106000 for lustre-OST0000 00000020:00000080:0.0:1787430757.743610:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc8045e80 20000000:00000080:0.0:1787430757.743629:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f1c70dd000 uarg=0000000000000000 20000000:01000000:0.0:1787430757.743679:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787430757.743686:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787430757.743691:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787430757.744466:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787430757.744591:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787430757.748097:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787430757.748152:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787430757.748203:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787430757.748220:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787430757.748238:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748258:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748267:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748282:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748289:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748296:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748303:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748535:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748551:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 18 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.748566:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec137800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133120:0@lo:104: 00000100:00100000:3.0:1787430757.748630:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430757.748735:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748744:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 18 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.748753:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec134000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133248:0@lo:104: 00000100:00100000:3.0:1787430757.748772:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787430757.748908:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.748922:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.748931:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec133b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133376:0@lo:104: 00000100:00100000:3.0:1787430757.748953:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430757.748971:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856133120 00000100:00100000:2.0:1787430757.748978:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856133120 00000100:00100000:2.0:1787430757.749051:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856133248 00000100:00100000:2.0:1787430757.749055:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856133248 00000100:00100000:0.0:1787430757.750073:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787430757.750113:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856133376 00000100:00100000:0.0:1787430757.750117:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856133376 00000100:00100000:0.0:1787430757.750140:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787430757.750156:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.750171:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 12 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.750182:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec133800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133504:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430757.750220:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:11665:x1874256856133120:12345-0@lo:104: 00010000:00010000:0.0:1787430757.750234:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430757.750271:0:8453:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1787430757.750278:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430757.750290:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:11665:x1874256856133248:12345-0@lo:104: 00010000:00010000:1.0:1787430757.750300:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.750703:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787430757.750712:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:11665:x1874256856133120:12345-0@lo:104: Request processed in 494us (2081us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430757.750719:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787430757.750727:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+5:11665:x1874256856133248:12345-0@lo:104: Request processed in 440us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430757.750818:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787430757.750826:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430757.750854:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787430757.750861:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:11665:x1874256856133376:12345-0@lo:104: 00010000:00010000:3.0:1787430757.750872:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.750889:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.750890:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.750915:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec132680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133632:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430757.750960:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787430757.750966:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+4:11665:x1874256856133376:12345-0@lo:104: Request processed in 106us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430757.750972:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787430757.751039:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787430757.751046:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751054:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430757.751059:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751078:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430757.751085:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430757.751090:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430757.751108:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430757.751115:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.751123:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:0.0:1787430757.751125:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430757.751127:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751143:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430757.751148:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430757.751157:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430757.751163:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787430757.751167:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751176:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e68e5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.751185:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751190:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430757.751193:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430757.751196:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751205:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430757.751209:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.751215:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751216:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.751236:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e68e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430757.751237:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430757.751259:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787430757.751262:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430757.751266:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430757.751268:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430757.751275:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430757.751279:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751286:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787430757.751290:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856133760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430757.751295:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751303:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a5200/0x1fa5b1e070e68e42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e68e49 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751317:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430757.751319:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430757.751322:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430757.751348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430757.751376:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856133888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430757.751392:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856134016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430757.751410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430757.751494:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffe480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430757.751518:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec137800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133120:0@lo:104: 00000100:00100000:3.0:1787430757.751527:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec134000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133248:0@lo:104: 00000100:00100000:3.0:1787430757.751534:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec133b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133376:0@lo:104: 00000100:00100000:1.0:1787430757.751565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430757.751620:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856133760 00000100:00100000:3.0:1787430757.751627:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856133760 00010000:00010000:3.0:1787430757.751663:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 19 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430757.751691:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856133888 00000100:00100000:1.0:1787430757.751697:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856133888 00000100:00100000:3.0:1787430757.751701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134016 00000100:00100000:3.0:1787430757.751707:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134016 00010000:00010000:1.0:1787430757.751717:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 21 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.751738:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 21 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430757.751742:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430757.751754:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430757.751756:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+21:3310:x1874256856133760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430757.751768:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787430757.751768:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:839a7a74-1b4a-4cd3-9548-e5ffe194716c+21:3307:x1874256856133888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430757.751770:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787430757.751782:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787430757.751782:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 21 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.751784:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430757.751794:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 21 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.751803:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 21 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.751807:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787430757.751820:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787430757.751829:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+21:3308:x1874256856134016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430757.751837:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430757.751842:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 21 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.752016:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 21 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.752032:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e68e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68e50 expref: 21 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.752054:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430757.752087:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:839a7a74-1b4a-4cd3-9548-e5ffe194716c+20:3307:x1874256856133888:12345-0@lo:103:ldlm_bl.0 Request processed in 324us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430757.752094:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430757.752119:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856133888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430757.752134:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68e5e expref: 19 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.752138:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 19 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430757.752156:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e68e49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e68e42 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.752158:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430757.752202:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:3310:x1874256856133760:12345-0@lo:103:ldlm_bl.0 Request processed in 450us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430757.752216:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787430757.752232:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430757.752272:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3308:x1874256856134016:12345-0@lo:103:ldlm_bl.0 Request processed in 444us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430757.752288:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430757.752304:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856133760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430757.752312:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856134016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430757.752763:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec133800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133504:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430757.753132:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430757.753176:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427328 00000100:00100000:2.0:1787430757.753183:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427328 00010000:00010000:2.0:1787430757.753214:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 13 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430757.753247:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:2.0:1787430757.753257:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841427328:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430757.753267:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430757.753273:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 13 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430757.753285:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 13 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430757.753295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:2.0:1787430757.753301:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68e3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14514 expref: 13 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430757.753322:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430757.753381:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427456 00000100:00100000:1.0:1787430757.753386:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427456 00000100:00100000:2.0:1787430757.753402:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841427328:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430757.753410:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00010000:00010000:1.0:1787430757.753469:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430757.753495:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:0.0:1787430757.753551:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec132680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874256856133632:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430757.753580:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:2374:x1874256841427456:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430757.753591:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430757.753596:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.753684:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753698:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753802:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147bc00/0x1fa5b1e070e68e34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1450d expref: 12 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753815:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753823:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753837:0:8455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753844:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753855:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753862:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753868:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430757.753871:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753880:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753895:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430757.753905:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430757.753917:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.753927:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430757.753934:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e68f92 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430757.753947:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:2374:x1874256841427456:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 443us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430757.753956:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00010000:00010000:1.0:1787430758.428743:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787430759.068554:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430759.068580:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c4de8800 from 7 10000000:01000000:3.0:1787430759.068585:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430759.068643:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.068655:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.068666:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430759.068692:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.068764:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.068873:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430759.068954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134144 00000100:00100000:0.0:1787430759.068962:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134144 00000100:00100000:0.0:1787430759.069028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787430759.069037:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:5834:x1874256856134144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430759.069050:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430759.069064:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f30216ca00/0x1fa5b1e070e68fa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68f99 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.069100:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f30216ca00/0x1fa5b1e070e68fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68f99 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.069111:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f30216ca00/0x1fa5b1e070e68fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68f99 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.069120:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216ca00, rc 0) 00000100:00100000:0.0:1787430759.069309:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856134144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.069316:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787430759.069668:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430759.069686:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.069695:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430759.069751:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.069778:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.069812:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430759.069879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134272 00000100:00100000:0.0:1787430759.069883:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134272 00000100:00100000:0.0:1787430759.069915:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787430759.069923:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856134272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430759.070225:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856134272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.070232:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787430759.073091:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.073158:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.073237:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.073369:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430759.075975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134400 00000100:00100000:0.0:1787430759.075991:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134400 00000100:00100000:0.0:1787430759.076121:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787430759.076132:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856134400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430759.076396:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856134400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (3158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.076404:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787430759.076503:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.077017:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11679:1874256856134528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430759.077065:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.078096:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134528 00000100:00100000:0.0:1787430759.078109:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134528 00000100:00100000:2.0:1787430759.078212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787430759.078225:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:11679:x1874256856134528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430759.078450:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:11679:x1874256856134528:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.078458:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787430759.078714:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430759.078752:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11679:1874256856134528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430759.078965:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430759.078978:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430759.078980:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430759.078987:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0f1c4de8800 00000020:00000080:3.0:1787430759.078990:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787430759.079086:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11679:1874256856134656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430759.079129:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430759.079155:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430759.080219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134656 00000100:00100000:3.0:1787430759.080227:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134656 00000100:00100000:3.0:1787430759.080271:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787430759.080282:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:11679:x1874256856134656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430759.080743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d5156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:11679:x1874256856134656:12345-0@lo:502:llog_process_th.0 Request processed in 463us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.080752:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787430759.080830:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11679:1874256856134656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430759.080862:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430759.080870:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430759.080872:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787430759.080877:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787430759.080995:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787430759.081019:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430759.081030:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.081042:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430759.081052:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430759.081055:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2c562b800 from 7 10000000:01000000:0.0:1787430759.081057:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430759.081090:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.081098:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.081107:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430759.081126:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430759.081163:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.081227:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430759.081662:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134784 00000100:00100000:1.0:1787430759.081669:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134784 00000100:00100000:1.0:1787430759.081711:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787430759.081721:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:5834:x1874256856134784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430759.081733:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430759.081746:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68fae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68fa7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.081884:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68fa7 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.082036:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68fa7 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.082046:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4600, rc 0) 00000100:00100000:1.0:1787430759.082133:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2dac9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856134784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430759.082140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787430759.082214:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430759.082228:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.082237:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430759.082295:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430759.082324:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.082422:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09480 going to sleep for 11 seconds 00000100:00100000:3.0:1787430759.082569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856134912 00000100:00100000:3.0:1787430759.082634:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856134912 00000100:00100000:3.0:1787430759.082719:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787430759.082730:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856134912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.083163:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856134912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.083170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787430759.083228:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856134912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430759.083263:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430759.083305:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430759.083364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135040 00000100:00100000:1.0:1787430759.083369:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135040 00000100:00100000:1.0:1787430759.083416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787430759.083427:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856135040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430759.083504:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09480 going to sleep for 11 seconds 00000100:00100000:1.0:1787430759.083584:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856135040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430759.083592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787430759.083602:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430759.085475:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11681:1874256856135168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430759.085551:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.085600:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430759.085642:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135168 00000100:00100000:0.0:1787430759.085650:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135168 00000100:00100000:0.0:1787430759.085694:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787430759.085704:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:11681:x1874256856135168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430759.085905:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:11681:x1874256856135168:12345-0@lo:502:llog_process_th.0 Request processed in 201us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.085913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787430759.085959:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11681:1874256856135168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430759.085990:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430759.086001:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430759.086003:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430759.086011:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0f2c562b800 00000020:00000080:2.0:1787430759.086013:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787430759.086141:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11681:1874256856135296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430759.086182:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.086205:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135296 00000100:00100000:2.0:1787430759.086208:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135296 00000100:00100000:2.0:1787430759.086232:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787430759.086239:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:11681:x1874256856135296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430759.086919:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:11681:x1874256856135296:12345-0@lo:502:llog_process_th.0 Request processed in 679us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.086926:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787430759.086964:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430759.086980:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c66e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11681:1874256856135296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430759.087003:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430759.087008:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430759.087010:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787430759.087015:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787430759.087214:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787430759.087234:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430759.087244:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.087256:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430759.087267:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430759.087269:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2d0492800 from 7 10000000:01000000:3.0:1787430759.087272:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430759.087294:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.087303:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.087312:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430759.087360:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.087391:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.087439:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430759.087474:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135424 00000100:00100000:0.0:1787430759.087478:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135424 00000100:00100000:0.0:1787430759.087503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787430759.087509:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:5834:x1874256856135424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430759.087520:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430759.087534:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68fbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e68fb5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.087556:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e68fb5 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.087567:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e68fb5 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.087576:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216ce00, rc 0) 00000100:00100000:3.0:1787430759.087643:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430759.087664:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430759.087673:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430759.087715:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430759.090720:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856135424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3200us (3318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.090734:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787430759.090765:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430759.090950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135552 00000100:00100000:0.0:1787430759.090958:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135552 00000100:00100000:3.0:1787430759.090981:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430759.091089:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787430759.091100:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856135552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430759.091403:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856135552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430759.091410:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787430759.091451:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec130700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430759.091508:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430759.091553:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430759.091568:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c10903c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430759.091579:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135680 00000100:00100000:1.0:1787430759.091582:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135680 00000100:00100000:1.0:1787430759.091602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787430759.091621:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856135680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430759.091760:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:5834:x1874256856135680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430759.091766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787430759.091801:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:839a7a74-1b4a-4cd3-9548-e5ffe194716c:5834:1874256856135680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430759.092010:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11684:1874256856135808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430759.092041:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430759.092057:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135808 00000100:00100000:1.0:1787430759.092060:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135808 00000100:00100000:1.0:1787430759.092078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787430759.092083:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:11684:x1874256856135808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430759.092190:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:11684:x1874256856135808:12345-0@lo:502:llog_process_th.0 Request processed in 105us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430759.092196:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787430759.092221:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c10900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430759.092233:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11684:1874256856135808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787430759.092251:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430759.092260:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430759.092263:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787430759.092268:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0f2d0492800 00000020:00000080:1.0:1787430759.092276:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787430759.092667:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11684:1874256856135936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430759.092703:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430759.092733:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232180 going to sleep for 11 seconds 00000040:00080000:0.0:1787430759.092773:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787430759.092893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856135936 00000100:00100000:2.0:1787430759.092905:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856135936 00000100:00100000:2.0:1787430759.092938:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787430759.092947:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:11684:x1874256856135936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430759.093129:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:11684:x1874256856135936:12345-0@lo:502:llog_process_th.0 Request processed in 183us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.093138:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787430759.093204:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:839a7a74-1b4a-4cd3-9548-e5ffe194716c:11684:1874256856135936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430759.093228:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430759.093233:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430759.093235:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787430759.093240:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787430759.093296:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787430759.093319:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430759.093506:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.093517:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430759.452520:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787430759.668772:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787430759.668817:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787430759.668826:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787430759.668997:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856136064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787430759.669074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430759.669197:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136064 00000100:00100000:2.0:1787430759.669205:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136064 00000100:00100000:2.0:1787430759.669273:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430759.669284:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856136064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787430759.669311:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:3.0:1787430759.669315:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787430759.669368:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8a0762, atime: 0x6a8a0762, ctime: 0x6a8a0762, blocks: 0x1 00010000:00010000:2.0:1787430759.669377:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.669393:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=223s v=(0 0) 00010000:00010000:2.0:1787430759.669398:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430759.669405:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.669894:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.669906:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.669914:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.669935:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430759.669969:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430759.669979:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.669988:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430759.669994:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.670010:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.670031:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.670038:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e68fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430759.670060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430759.670062:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430759.670064:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430759.670562:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856136064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1279us (1487us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787430759.670572:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1787430759.670632:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2ec131180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787430759.670639:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856136064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787430759.769123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430759.769526:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427584 00000100:00100000:2.0:1787430759.769763:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427584 00000100:00100000:2.0:1787430759.769940:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 246 00000100:00100000:2.0:1787430759.769951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:5607:x1874256841427584:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430759.770174:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430759.770197:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68fca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14561 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.770227:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14561 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.770251:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68fca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14561 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.770278:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75600, rc 0) 00000100:00100000:2.0:1787430759.770365:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841427584:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 415us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.770373:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 246 00000100:00100000:2.0:1787430759.776883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430759.777084:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427712 00000100:00100000:3.0:1787430759.777095:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427712 00000100:00100000:3.0:1787430759.777149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 247 00000100:00100000:3.0:1787430759.777160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841427712:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.777488:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841427712:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 329us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.777497:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 247 00000100:00100000:3.0:1787430759.780510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430759.780887:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427840 00000100:00100000:0.0:1787430759.780900:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427840 00000100:00100000:0.0:1787430759.781015:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 248 00000100:00100000:0.0:1787430759.781029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841427840:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430759.781375:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841427840:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 347us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.781384:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 248 00000100:00100000:0.0:1787430759.786094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430759.786269:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841427968 00000100:00100000:2.0:1787430759.786284:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841427968 00000100:00100000:2.0:1787430759.786393:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 249 00000100:00100000:2.0:1787430759.786407:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:9946:x1874256841427968:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430759.786764:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:9946:x1874256841427968:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 359us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.786774:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 249 00000100:00100000:2.0:1787430759.790247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430759.790481:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428096 00000100:00100000:0.0:1787430759.790493:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428096 00000100:00100000:0.0:1787430759.790566:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 250 00000100:00100000:0.0:1787430759.790611:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:9946:x1874256841428096:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430759.790944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:9946:x1874256841428096:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 347us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.790953:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 250 00000100:00100000:3.0:1787430759.803665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430759.804115:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428224 00000100:00100000:2.0:1787430759.804130:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428224 00000100:00100000:2.0:1787430759.804204:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 251 00000100:00100000:2.0:1787430759.804216:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:5607:x1874256841428224:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430759.804239:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430759.804265:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e68fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14568 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.804302:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e68fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14568 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.804315:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e68fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14568 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430759.804377:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74200, rc 0) 00000100:00100000:2.0:1787430759.804466:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841428224:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 251us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.804474:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 251 00000100:00100000:1.0:1787430759.807642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430759.807785:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428352 00000100:00100000:3.0:1787430759.807798:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428352 00000100:00100000:3.0:1787430759.807937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 252 00000100:00100000:3.0:1787430759.807951:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841428352:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430759.808378:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841428352:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 430us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.808399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 252 00000100:00100000:3.0:1787430759.811112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430759.811208:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428480 00000100:00100000:0.0:1787430759.811220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428480 00000100:00100000:0.0:1787430759.811288:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 253 00000100:00100000:0.0:1787430759.811299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841428480:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430759.811643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:5607:x1874256841428480:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 344us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430759.811652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 253 00000100:00100000:0.0:1787430759.818940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430759.819142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428608 00000100:00100000:3.0:1787430759.819154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428608 00000100:00100000:3.0:1787430759.819234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 254 00000100:00100000:3.0:1787430759.819292:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:9949:x1874256841428608:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787430759.819662:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:9949:x1874256841428608:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 369us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430759.819672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 254 00000100:00100000:1.0:1787430759.824688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430759.824813:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428736 00000100:00100000:2.0:1787430759.824826:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428736 00000100:00100000:2.0:1787430759.824903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 255 00000100:00100000:2.0:1787430759.824918:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:9949:x1874256841428736:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430759.825353:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:9949:x1874256841428736:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 351us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430759.825365:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 255 00000040:00080000:1.0:1787430760.157197:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787430760.189120:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24bdbdfb-c1b7-4700-ba76-999d38d57629 00000020:00000080:3.0:1787430760.189133:0:7647:0:(genops.c:885:class_export_put()) final put ffffa0f2ec102000/24bdbdfb-c1b7-4700-ba76-999d38d57629 00000001:00080000:3.0:1787430760.189251:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000020:00000080:2.0:1787430760.189522:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec102000/24bdbdfb-c1b7-4700-ba76-999d38d57629 for lustre-OST0001 00000020:00000080:3.0:1787430760.189642:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2ec105800 for lustre-OST0001 00000100:00100000:2.0:1787430760.473252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430760.473390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430760.473419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430760.473468:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428864 00000100:00100000:1.0:1787430760.473483:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428864 00000100:00100000:3.0:1787430760.473509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429120 00000100:00100000:3.0:1787430760.473516:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429120 00000100:00100000:3.0:1787430760.473592:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:3.0:1787430760.473606:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841429120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430760.473612:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841428992 00000100:00100000:0.0:1787430760.473618:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841428992 00000100:00100000:0.0:1787430760.473657:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:0.0:1787430760.473664:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841428992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430760.473707:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841428992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430760.473709:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841429120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430760.473716:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:3.0:1787430760.473725:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00080000:2.0:1787430760.473883:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430760.473900:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430760.479109:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:1.0:1787430760.479148:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841428864:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430760.479297:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841428864:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 171us (5906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430760.479306:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00010000:00010000:1.0:1787430760.479423:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430761.502034:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430761.692928:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856136192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430761.693008:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430761.693285:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136192 00000100:00100000:2.0:1787430761.693293:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136192 00000100:00100000:2.0:1787430761.693376:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787430761.693387:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856136192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430761.693432:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430761.693485:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856136192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430761.693492:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787430761.693608:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fc380 x1874256856136192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430761.693639:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856136192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787430761.693845:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430762.524730:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430762.716513:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856136448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430762.716519:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856136320:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.716605:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856136704:0@lo:400:kworker.0 00000100:00100000:2.0:1787430762.716616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430762.716617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430762.716661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430762.716692:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856136832:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.716692:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787430762.716693:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856136960:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.716709:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856136576:0@lo:400:kworker.0 00000100:00100000:2.0:1787430762.716736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430762.716756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430762.716771:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136448 00000100:00100000:1.0:1787430762.716778:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136448 00000100:00100000:2.0:1787430762.716783:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136832 00000100:00100000:2.0:1787430762.716789:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136832 00000100:00100000:0.0:1787430762.716802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856137088:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.716834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430762.716840:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430762.716855:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856136832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430762.716857:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136320 00000100:00100000:1.0:1787430762.716862:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787430762.716864:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136320 00000100:00100000:0.0:1787430762.716878:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136704 00000100:00100000:1.0:1787430762.716880:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856136448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430762.716884:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136704 00000100:00100000:3.0:1787430762.716908:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00002000:00000024:1.0:1787430762.716915:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430762.716926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136576 00000100:00100000:0.0:1787430762.716930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136576 00000100:00100000:2.0:1787430762.716936:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856136832:12345-0@lo:400:kworker.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430762.716946:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787430762.716966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787430762.716968:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856136448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430762.716969:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137088 00000100:00100000:3.0:1787430762.716973:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856136320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430762.716976:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137088 00000100:00100000:0.0:1787430762.716980:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856136704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430762.716988:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430762.717009:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787430762.717020:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856137088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430762.717033:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856136320:12345-0@lo:400:kworker.0 Request processed in 66us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430762.717040:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1787430762.717060:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430762.717061:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856136704:12345-0@lo:400:kworker.0 Request processed in 84us (398us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430762.717071:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430762.717073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787430762.717080:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856137088:12345-0@lo:400:kworker.0 Request processed in 62us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430762.717085:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856136576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.717085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787430762.717095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430762.717096:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787430762.717109:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856136960 00000100:00100000:0.0:1787430762.717113:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856136960 00000100:00100000:3.0:1787430762.717139:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856136576:12345-0@lo:400:kworker.0 Request processed in 57us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430762.717142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787430762.717144:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000100:00100000:0.0:1787430762.717152:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856136960:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1787430762.717154:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2ec131180, transno 4294967300 00000100:00100000:3.0:1787430762.717157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1787430762.717169:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2c35fc380 x1874256856136832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430762.717183:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856136448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430762.717184:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856136832:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.717189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856136960:12345-0@lo:400:kworker.0 Request processed in 36us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430762.717199:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787430762.717209:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856136320:0@lo:400:kworker.0 00000100:00100000:1.0:1787430762.717223:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856136960:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.717245:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856136576:0@lo:400:kworker.0 00000100:00080000:1.0:1787430762.717258:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430762.717286:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856137088:0@lo:400:kworker.0 00000100:00100000:0.0:1787430762.717299:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856136704:0@lo:400:kworker.0 00010000:00010000:1.0:1787430763.549115:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430764.572523:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430765.596554:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430765.596574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430765.596609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430765.596639:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429376 00000100:00100000:3.0:1787430765.596649:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429376 00000100:00100000:2.0:1787430765.596653:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430765.596712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430765.596721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429632 00000100:00100000:3.0:1787430765.596726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429632 00000100:00100000:1.0:1787430765.596729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429248 00000100:00100000:1.0:1787430765.596735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429248 00000100:00100000:2.0:1787430765.596741:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429504 00000100:00100000:2.0:1787430765.596747:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429504 00000100:00100000:3.0:1787430765.596765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:1.0:1787430765.596779:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 257 00000100:00100000:3.0:1787430765.596780:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841429376:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430765.596789:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:1.0:1787430765.596799:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841429248:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430765.596802:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841429504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430765.596859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841429376:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430765.596867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:0.0:1787430765.596880:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:0.0:1787430765.596898:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841429632:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430765.597025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841429248:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 229us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430765.597033:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 257 00000100:00080000:1.0:1787430765.597061:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430765.597065:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430765.598241:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841429504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1440us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430765.598252:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:0.0:1787430765.599557:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841429632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2662us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430765.599583:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00010000:00010000:1.0:1787430766.620544:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430766.812771:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856137216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430766.812837:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430766.813071:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137216 00000100:00100000:1.0:1787430766.813079:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137216 00000100:00100000:1.0:1787430766.813261:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787430766.813272:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856137216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430766.813309:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430766.813384:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856137216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430766.813392:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787430766.813422:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2ec136680 x1874256856137216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430766.813442:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856137216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787430766.813518:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787430767.644474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430767.836571:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430767.836594:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856137344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430767.836959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430767.837031:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137344 00000100:00100000:2.0:1787430767.837038:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137344 00000100:00100000:2.0:1787430767.837105:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787430767.837115:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856137344:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787430767.837138:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787430767.837150:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430767.837209:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856137344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430767.837216:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787430767.837305:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856137472:0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837360:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430767.837425:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856137856:0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837428:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856137344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430767.837461:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856137984:0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.837473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430767.837507:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430767.837510:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137856 00000100:00100000:2.0:1787430767.837515:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137856 00000100:00100000:3.0:1787430767.837548:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137472 00000100:00100000:2.0:1787430767.837552:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787430767.837555:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137472 00000100:00100000:2.0:1787430767.837563:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856137856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837591:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787430767.837601:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856137472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.837606:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856137856:12345-0@lo:400:kworker.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430767.837621:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787430767.837658:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe6ded80 x1874256856137856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430767.837659:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856137472:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430767.837676:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787430767.837682:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856137856:0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837708:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137984 00000100:00100000:3.0:1787430767.837712:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137984 00000100:00100000:2.0:1787430767.837725:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856137600:0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837745:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787430767.837754:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856137984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.837762:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430767.837787:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430767.837794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856137728:0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837801:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856137984:12345-0@lo:400:kworker.0 Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430767.837809:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787430767.837822:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137600 00000100:00100000:2.0:1787430767.837823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430767.837827:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137600 00000100:00100000:3.0:1787430767.837854:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856137728 00000100:00100000:3.0:1787430767.837857:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856137728 00000100:00080000:2.0:1787430767.837863:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430767.837878:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787430767.837885:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856137600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.837917:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856137600:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430767.838571:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430767.838581:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856137728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.838622:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856137728:12345-0@lo:400:kworker.0 Request processed in 44us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430767.838628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787430767.838659:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856137984:0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.838669:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856137472:0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.838702:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856137728:0@lo:400:kworker.0 00000100:00100000:2.0:1787430767.838713:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856137600:0@lo:400:kworker.0 00000100:00100000:3.0:1787430767.838893:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1787430768.668548:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430769.692582:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430770.397572:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787430770.713235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430770.713269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430770.713391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430770.713469:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429760 00000100:00100000:1.0:1787430770.713503:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429760 00000100:00100000:0.0:1787430770.713553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430770.713598:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430016 00000100:00100000:0.0:1787430770.713602:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430016 00000100:00100000:0.0:1787430770.713663:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:0.0:1787430770.713673:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841430016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430770.713756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 259 00000100:00100000:1.0:1787430770.713764:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841429760:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430770.713829:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841430016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 157us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430770.713837:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00080000:0.0:1787430770.713859:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430770.714174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841429888 00000100:00100000:3.0:1787430770.714179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430144 00000100:00100000:2.0:1787430770.714180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841429888 00000100:00100000:3.0:1787430770.714187:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430144 00000100:00100000:3.0:1787430770.714232:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:2.0:1787430770.714240:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787430770.714244:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841430144:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430770.714252:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841429888:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430770.714317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841429760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 553us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430770.714324:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 259 00000100:00080000:1.0:1787430770.714388:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430770.714586:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841429888:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 336us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430770.714594:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787430770.714879:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841430144:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 637us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430770.714886:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00010000:00010000:1.0:1787430770.716453:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430771.741413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430771.934291:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787430771.934314:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856138112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430771.934426:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430771.934737:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138112 00000100:00100000:3.0:1787430771.934746:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138112 00000100:00100000:3.0:1787430771.934824:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787430771.934838:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856138112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430771.934874:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430771.934937:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856138112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (511us total) trans 0 rc 0/0 00000100:00080000:1.0:1787430771.934938:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430771.934949:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787430771.935345:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe6dd180 x1874256856138112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430771.935375:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856138112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787430772.764448:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430772.956551:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430772.956575:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856138240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430772.956606:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430772.956625:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856138496:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.956652:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430772.956666:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430772.956709:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856138368:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.956713:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856138624:0@lo:400:kworker.0 00000100:00100000:2.0:1787430772.956766:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430772.956766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430772.956777:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856138880:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.956799:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430772.956811:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856138752:0@lo:400:kworker.0 00000100:00100000:2.0:1787430772.956850:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138368 00000100:00100000:2.0:1787430772.956860:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138368 00000100:00100000:0.0:1787430772.956863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430772.956869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430772.956913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787430772.956924:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856138368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.957120:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138496 00000100:00100000:1.0:1787430772.957126:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138496 00000100:00100000:2.0:1787430772.957137:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856138368:12345-0@lo:400:kworker.0 Request processed in 214us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430772.957145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787430772.957159:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138624 00000100:00100000:1.0:1787430772.957176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138880 00000100:00100000:1.0:1787430772.957180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138880 00000100:00100000:0.0:1787430772.957188:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138624 00000100:00100000:2.0:1787430772.957212:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856138368:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.957229:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787430772.957242:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856138496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430772.957264:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787430772.957279:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856138880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430772.957314:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138240 00000100:00100000:2.0:1787430772.957320:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138240 00000100:00100000:3.0:1787430772.957431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787430772.957443:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856138624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.957453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856138496:12345-0@lo:400:kworker.0 Request processed in 213us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430772.957463:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787430772.957498:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856138752 00000100:00100000:1.0:1787430772.957502:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856138752 00000100:00100000:1.0:1787430772.957530:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787430772.957639:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430772.957647:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856138240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430772.957674:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430772.957814:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856138752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430772.958016:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856138880:12345-0@lo:400:kworker.0 Request processed in 739us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430772.958027:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787430772.958052:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856138240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 402us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430772.958063:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787430772.958101:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856138880:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.958138:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856138752:12345-0@lo:400:kworker.0 Request processed in 599us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430772.958165:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787430772.958175:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856138496:0@lo:400:kworker.0 00000100:00100000:3.0:1787430772.958398:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856138624:12345-0@lo:400:kworker.0 Request processed in 957us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430772.958407:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787430772.958480:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe6dd500 x1874256856138752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430772.958494:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856138752:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.958509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856138624:0@lo:400:kworker.0 00000100:00100000:1.0:1787430772.958526:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856138240:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787430772.958983:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430772.958998:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787430773.788664:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430774.812578:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430775.833495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430775.833543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430775.833621:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430272 00000100:00100000:1.0:1787430775.833630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430272 00000100:00100000:2.0:1787430775.833677:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430400 00000100:00100000:2.0:1787430775.833682:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430400 00000100:00100000:1.0:1787430775.833689:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 261 00000100:00100000:1.0:1787430775.833702:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841430272:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430775.833741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:2.0:1787430775.833750:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841430400:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430775.833793:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2371:x1874256841430400:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430775.833793:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841430272:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430775.833802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:1.0:1787430775.833814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 261 00000100:00080000:0.0:1787430775.834360:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787430775.836489:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430775.864004:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430775.864045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430775.864220:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430528 00000100:00100000:0.0:1787430775.864229:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430528 00000100:00100000:0.0:1787430775.864307:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:0.0:1787430775.864317:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2370:x1874256841430528:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:0.0:1787430775.864363:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68f0d 00000100:00080000:0.0:1787430775.864373:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec26d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430775.864424:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787430775.864616:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430656 00000100:00100000:1.0:1787430775.864622:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430656 00000100:00100000:1.0:1787430775.864661:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:1.0:1787430775.864669:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2371:x1874256841430656:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430775.864735:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2371:x1874256841430656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 67us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430775.864743:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 76 00010000:00010000:1.0:1787430775.864765:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430775.865010:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430775.865015:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430775.865994:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+2:2370:x1874256841430528:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 1675us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430775.866003:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00010000:00010000:0.0:1787430776.862415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430777.052530:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856139008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430777.052605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430777.055284:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139008 00000100:00100000:3.0:1787430777.055299:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139008 00000100:00100000:3.0:1787430777.055426:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787430777.055448:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856139008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430777.055485:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430777.055574:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856139008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430777.055581:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787430777.055822:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe6dc000 x1874256856139008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430777.055853:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856139008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787430777.055933:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787430777.886161:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430778.077072:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856139136:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.077113:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856139264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430778.080008:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856139520:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.084840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430778.084928:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856139776:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.084980:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430778.085010:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430778.085017:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856139648:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.085046:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430778.085087:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139264 00000100:00100000:0.0:1787430778.085095:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139264 00000100:00100000:0.0:1787430778.085153:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787430778.085162:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856139264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430778.086407:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430778.086616:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856139264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1452us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430778.086625:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787430778.086659:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139776 00000100:00100000:0.0:1787430778.086665:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139776 00000100:00100000:0.0:1787430778.088192:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430778.088206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.088287:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856139776:12345-0@lo:400:kworker.0 Request processed in 85us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430778.088294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430778.088338:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139648 00000100:00100000:0.0:1787430778.088343:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139648 00000100:00100000:0.0:1787430778.088377:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787430778.088383:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856139648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.088413:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856139648:12345-0@lo:400:kworker.0 Request processed in 31us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430778.088419:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787430778.088436:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430778.088448:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787430778.088655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe6ddc00 x1874256856139648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430778.088673:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856139648:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.088735:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856139264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430778.088846:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856139776:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.088922:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856139392:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.088957:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430778.088983:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856139904:0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.089005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430778.089047:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139392 00000100:00100000:0.0:1787430778.089052:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139392 00000100:00100000:0.0:1787430778.089077:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430778.089083:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856139392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.089118:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856139392:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430778.089124:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787430778.089147:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856139392:0@lo:400:kworker.0 00000100:00100000:3.0:1787430778.090244:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139904 00000100:00100000:3.0:1787430778.090251:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139904 00000100:00100000:3.0:1787430778.090304:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787430778.090312:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430778.090755:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856139904:12345-0@lo:400:kworker.0 Request processed in 444us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430778.090763:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787430778.090810:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856139904:0@lo:400:kworker.0 00000100:00100000:1.0:1787430778.091613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430778.092609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430778.095014:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139520 00000100:00100000:1.0:1787430778.095030:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139520 00000100:00100000:1.0:1787430778.095109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430778.095119:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856139520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430778.095228:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856139520:12345-0@lo:400:kworker.0 Request processed in 110us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430778.095247:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430778.095298:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856139520:0@lo:400:kworker.0 00000100:00080000:3.0:1787430778.095762:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430778.095973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856139136 00000100:00100000:0.0:1787430778.095980:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856139136 00000100:00100000:0.0:1787430778.098098:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787430778.098121:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856139136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430778.098244:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856139136:12345-0@lo:400:kworker.0 Request processed in 119us (6619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430778.099728:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787430778.099911:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856139136:0@lo:400:kworker.0 00010000:00010000:2.0:1787430778.913370:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430779.932536:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430780.637378:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787430780.725807:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:3.0:1787430780.725817:0:7647:0:(genops.c:885:class_export_put()) final put ffffa0f2ec26a800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:1.0:1787430780.726028:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec26a800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-OST0001 00000020:00000080:1.0:1787430780.726075:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2ec26d000 for lustre-OST0001 00000100:00100000:2.0:1787430780.953802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430780.953845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430780.953887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430780.953918:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431040 00000100:00100000:2.0:1787430780.953927:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431040 00000100:00100000:2.0:1787430780.953986:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430912 00000100:00100000:2.0:1787430780.953989:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430912 00000100:00100000:2.0:1787430780.954014:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:2.0:1787430780.954024:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841431040:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430780.954227:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841430784 00000100:00100000:3.0:1787430780.954232:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841430784 00000100:00100000:3.0:1787430780.954265:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 263 00000100:00100000:3.0:1787430780.954273:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841430784:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430780.954303:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841430784:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430780.954311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 263 00000100:00100000:3.0:1787430780.954402:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:3.0:1787430780.954410:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841430912:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430780.954436:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841430912:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430780.954443:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00080000:3.0:1787430780.954463:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430780.954897:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841431040:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430780.954907:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00010000:00010000:1.0:1787430780.958999:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430781.373826:0:11852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:32:59 (1787430779) 00010000:00010000:2.0:1787430781.980568:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430782.173992:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430782.174017:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856140032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430782.174087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430782.174240:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140032 00000100:00100000:0.0:1787430782.174249:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140032 00000100:00100000:0.0:1787430782.174317:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787430782.174468:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430782.174529:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856140032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430782.174564:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430782.174614:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856140032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 288us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430782.174621:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787430782.174712:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2fe6dfb80 x1874256856140032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430782.174742:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856140032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787430783.004652:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430783.197021:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856140544:0@lo:400:kworker.0 00000100:00100000:2.0:1787430783.197093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430783.197169:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430783.197176:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856140416:0@lo:400:kworker.0 00000100:00100000:2.0:1787430783.197201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430783.197232:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140544 00000100:00100000:2.0:1787430783.197238:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140544 00000100:00100000:2.0:1787430783.197282:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787430783.197291:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856140544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430783.197379:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856140544:12345-0@lo:400:kworker.0 Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430783.197386:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787430783.197424:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f2d8274a80 x1874256856140544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787430799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430783.197439:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8274a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856140544:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197515:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8276d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856140160:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197548:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430783.197583:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856140672:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197605:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430783.197624:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787430783.197629:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856140288:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197650:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430783.197666:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856140800:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430783.197710:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140416 00000100:00100000:3.0:1787430783.197714:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140416 00000100:00100000:3.0:1787430783.197751:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140672 00000100:00100000:3.0:1787430783.197754:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140672 00000100:00100000:3.0:1787430783.197770:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140288 00000100:00100000:3.0:1787430783.197772:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140288 00000100:00100000:3.0:1787430783.197784:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430783.197789:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856140416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197823:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856140416:12345-0@lo:400:kworker.0 Request processed in 33us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430783.197828:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430783.197840:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787430783.197846:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856140672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197891:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856140672:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430783.197897:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787430783.197909:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787430783.197914:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856140288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.197939:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856140288:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430783.197945:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787430783.197965:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140800 00000100:00100000:3.0:1787430783.197968:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140800 00000100:00100000:3.0:1787430783.197990:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430783.197995:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856140800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.198020:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856140800:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430783.198025:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787430783.198041:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430783.198046:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430783.198061:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856140288:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.198071:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856140800:0@lo:400:kworker.0 00000100:00100000:3.0:1787430783.198080:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856140672:0@lo:400:kworker.0 00000100:00100000:2.0:1787430783.199188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140160 00000100:00100000:2.0:1787430783.199200:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140160 00000100:00100000:2.0:1787430783.199244:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787430783.199252:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856140160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430783.199363:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856140160:12345-0@lo:400:kworker.0 Request processed in 112us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430783.199385:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787430783.199438:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856140416:0@lo:400:kworker.0 00000100:00100000:2.0:1787430783.199455:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430783.199463:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856140928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430783.199493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430783.199536:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856140928 00000100:00100000:2.0:1787430783.199540:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856140928 00000100:00100000:2.0:1787430783.199564:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430783.199570:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856140928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430783.199595:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430783.199629:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856140928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430783.199635:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430783.199666:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856140928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430783.199769:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8276d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856140160:0@lo:400:kworker.0 00000100:00100000:1.0:1787430783.203364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430783.205191:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431168 00000100:00100000:3.0:1787430783.205206:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431168 00000100:00100000:3.0:1787430783.205297:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:3.0:1787430783.205307:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:10219:x1874256841431168:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430783.205367:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430783.205404:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e68fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1456f expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430783.205478:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68fdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430783.205491:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430783.205505:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787430783.205673:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787430783.205898:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787430783.205903:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430783.205999:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430783.206029:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e68fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1456f expref: 7 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430783.206048:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68fdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1456f expref: 6 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430783.206057:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05800) 00010000:00010000:3.0:1787430783.206060:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430783.206064:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430783.206189:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:10219:x1874256841431168:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 882us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430783.206197:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:3.0:1787430783.229448:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430783.229562:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431296 00000100:00100000:0.0:1787430783.229573:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431296 00000100:00100000:0.0:1787430783.229640:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:0.0:1787430783.229651:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:10220:x1874256841431296:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430783.229674:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430783.229696:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e68fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14576 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.229773:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.229787:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.229799:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.229826:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.229833:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.229840:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230260:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263000/0x1fa5b1e070e68ffb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230270:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263000/0x1fa5b1e070e68ffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230278:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263000/0x1fa5b1e070e68ffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430783.230390:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787430783.230395:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430783.230473:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263000/0x1fa5b1e070e68ffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230484:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230491:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230498:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230513:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430783.230517:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230524:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230536:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05800) 00010000:00010000:0.0:1787430783.230539:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430783.230544:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230550:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e68fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230566:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230571:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230576:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230581:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430783.230584:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230589:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230608:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0f2d2bc4900) 00010000:00010000:0.0:1787430783.230611:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430783.230614:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230621:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e68ff4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230655:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e68fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14576 expref: 8 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230669:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263000/0x1fa5b1e070e68ffb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14576 expref: 7 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430783.230677:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0f2d2bc4e00) 00010000:00010000:0.0:1787430783.230679:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430783.230682:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263000, rc 0) 00000100:00100000:0.0:1787430783.230762:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:10220:x1874256841431296:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1112us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430783.230770:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:2.0:1787430783.250444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430783.250562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431552 00000100:00100000:1.0:1787430783.250582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431552 00000100:00100000:1.0:1787430783.250646:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:1.0:1787430783.250658:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:10220:x1874256841431552:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430783.250694:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430783.250716:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69002 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1457d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.250802:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.250817:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.250828:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.250870:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.250878:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.250884:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251483:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e69017 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e69017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251499:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e69017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430783.251509:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787430783.251743:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251752:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251757:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251763:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430783.251766:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251772:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251784:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0f2d2bc4e00) 00010000:00010000:1.0:1787430783.251787:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430783.251792:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251797:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69009 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251808:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251815:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251820:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251834:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430783.251839:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251845:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251853:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430783.251855:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430783.251858:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.251863:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69010 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.252256:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69002 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1457d expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.252271:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e69017 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1457d expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430783.252278:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430783.252280:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430783.252282:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5600, rc 0) 00000100:00100000:1.0:1787430783.252400:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:10220:x1874256841431552:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1743us (1963us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787430783.252410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:2.0:1787430783.274425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430783.274597:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431680 00000100:00100000:3.0:1787430783.274607:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431680 00000100:00100000:3.0:1787430783.274657:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:3.0:1787430783.274668:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:10220:x1874256841431680:12345-192.168.204.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787430783.274786:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:10220:x1874256841431680:12345-192.168.204.60@tcp:59:lhsmtool_posix.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430783.274794:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000040:00080000:0.0:1787430783.712630:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787430784.028457:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430785.063438:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787430785.376967:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1787430786.078014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430786.078061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430786.078105:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430786.078136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431936 00000100:00100000:2.0:1787430786.078145:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431936 00000100:00100000:2.0:1787430786.078200:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841432064 00000100:00100000:2.0:1787430786.078203:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841432064 00000100:00100000:2.0:1787430786.078225:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787430786.078235:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841431936:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430786.078349:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841431936:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 115us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430786.078357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787430786.078374:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:2.0:1787430786.078380:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841432064:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430786.078404:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841432064:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430786.078411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00080000:2.0:1787430786.078427:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430786.079404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841431808 00000100:00100000:0.0:1787430786.079412:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841431808 00000100:00100000:0.0:1787430786.079445:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 265 00000100:00100000:0.0:1787430786.079454:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841431808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430786.079495:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841431808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 42us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430786.079510:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 265 00010000:00010000:3.0:1787430786.081142:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430786.348821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.348904:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841432192 00000100:00100000:3.0:1787430786.348914:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841432192 00000100:00100000:3.0:1787430786.348976:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:3.0:1787430786.348988:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:10262:x1874256841432192:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430786.349008:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430786.349028:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14584 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349107:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349121:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349131:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349144:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349151:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349169:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349450:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349458:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349465:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349471:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430786.349475:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349482:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349494:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05800) 00010000:00010000:3.0:1787430786.349496:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430786.349501:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349507:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6902c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349519:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349525:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349537:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349541:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430786.349544:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349549:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349556:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430786.349558:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430786.349560:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349565:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349596:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69025 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14584 expref: 9 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349606:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05800) 00010000:00010000:3.0:1787430786.349608:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430786.349611:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14584 expref: 9 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.349619:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b800, rc 0) 00000100:00100000:3.0:1787430786.349677:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:10262:x1874256841432192:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 692us (867us total) trans 0 rc 301/301 00000100:00100000:3.0:1787430786.349693:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:3.0:1787430786.365159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430786.365250:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841432448 00000100:00100000:1.0:1787430786.365267:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841432448 00000100:00100000:1.0:1787430786.365322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:1.0:1787430786.365356:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:10262:x1874256841432448:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:1.0:1787430786.365410:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430786.365435:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e68fdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1456f expref: 8 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.365458:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05800) 00010000:00010000:1.0:1787430786.365468:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430786.365743:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.365756:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.365764:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.365778:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.365785:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.365790:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430786.366780:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787430786.366792:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.366809:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.366816:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.366822:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430786.366826:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.366832:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.366843:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430786.366846:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430786.366849:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.366855:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e6903a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430786.366868:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d241614 reply state 00000000d3f984cf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430786.366876:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430786.366977:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:10262:x1874256841432448:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 1620us (1826us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787430786.366984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 36 00010000:00010000:0.0:1787430786.375642:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.375659:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.375667:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.375673:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430786.375677:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.375686:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.375702:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0f2d0ce5000) 00010000:00010000:0.0:1787430786.375706:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430786.375709:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.375715:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69041 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430786.533231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430786.533378:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841432576 00000100:00100000:0.0:1787430786.533388:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841432576 00000100:00100000:0.0:1787430786.533447:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:0.0:1787430786.533458:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:10270:x1874256841432576:12345-192.168.204.60@tcp:101:lctl.0 00010000:00010000:0.0:1787430786.533480:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430786.533514:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1458b expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.533583:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6904f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.533595:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6904f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.533606:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6904f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430786.533661:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787430786.533665:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430786.533706:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6904f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.533743:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1458b expref: 10 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.533763:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6904f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1458b expref: 9 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.533771:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:0.0:1787430786.533774:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430786.533777:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430786.533839:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:10270:x1874256841432576:12345-192.168.204.60@tcp:101:lctl.0 Request processed in 384us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430786.533846:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:2.0:1787430786.604137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430786.604280:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841432704 00000100:00100000:1.0:1787430786.604291:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841432704 00000100:00100000:1.0:1787430786.605124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:1.0:1787430786.605138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:10276:x1874256841432704:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430786.605158:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430786.605177:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14592 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605246:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605350:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605364:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605379:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605386:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605392:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605553:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e6906b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605562:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e6906b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605569:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e6906b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430786.605615:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787430786.605618:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430786.605662:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e6906b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605675:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605681:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605688:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605694:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430786.605698:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605704:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605716:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:1.0:1787430786.605719:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430786.605723:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605729:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6905d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605743:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605759:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605765:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605770:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430786.605772:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605779:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605786:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430786.605788:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430786.605791:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605797:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69064 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605831:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14592 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605845:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e6906b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14592 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.605852:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430786.605855:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430786.605863:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5c00, rc 0) 00000100:00100000:1.0:1787430786.605934:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:10276:x1874256841432704:12345-192.168.204.60@tcp:101:bash.0 Request processed in 799us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430786.607971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:2.0:1787430786.611154:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.611246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841432960 00000100:00100000:3.0:1787430786.611264:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841432960 00000100:00100000:3.0:1787430786.611320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:3.0:1787430786.611358:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:10276:x1874256841432960:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787430786.611378:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430786.611397:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69072 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14599 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.611534:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.611548:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.611558:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.611631:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.611639:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.611646:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430786.612180:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787430786.612365:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612381:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612415:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612421:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612427:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612433:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430786.612437:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612444:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612456:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430786.612460:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430786.612465:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612470:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69079 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430786.612495:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e247d93 reply state 000000006824e9d0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430786.612504:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787430786.612534:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69072 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612549:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.612556:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:3.0:1787430786.612559:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430786.612561:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147ae00, rc 0) 00000100:00100000:3.0:1787430786.612631:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10276:x1874256841432960:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1277us (1485us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787430786.612639:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00010000:00010000:0.0:1787430786.621091:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.621121:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.621128:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.621134:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430786.621138:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.621146:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.621162:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2daf05b00) 00010000:00010000:0.0:1787430786.621165:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430786.621170:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.621176:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69080 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430786.623142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.624061:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841433088 00000100:00100000:3.0:1787430786.624082:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841433088 00000100:00100000:3.0:1787430786.624140:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:3.0:1787430786.624148:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1874256841433088:12345-192.168.204.60@tcp:8:bash.0 00010000:00080000:3.0:1787430786.624181:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1787430786.624217:0:6685:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e69095 00002000:00100000:3.0:1787430786.624228:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 711a801a-27eb-4d09-8ae0-8dc5ece71a10/ffffa0f2d8611000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787430786.624251:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787430786.624495:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787430786.624539:0:6685:0:(import.c:65:import_set_state_nolock()) ffffa0f2d8617800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430786.624610:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841433088:12345-192.168.204.60@tcp:8:bash.0 Request processed in 460us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430786.624617:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:2.0:1787430786.628769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430786.628822:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841433216 00000100:00100000:0.0:1787430786.628833:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841433216 00000100:00100000:0.0:1787430786.628919:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:0.0:1787430786.628930:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:0:x1874256841433216:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430786.628948:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430786.628973:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145a0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430786.629017:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430786.629036:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=250s v=(0 0) 00010000:00010000:0.0:1787430786.629040:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430786.629049:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.629082:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.629096:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262800, rc 0) 00000100:00100000:0.0:1787430786.629769:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:0:x1874256841433216:12345-192.168.204.60@tcp:101:bash.0 Request processed in 840us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430786.629777:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00080000:2.0:1787430786.629852:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430786.639019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.639119:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841433344 00000100:00100000:3.0:1787430786.639129:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841433344 00000100:00100000:3.0:1787430786.639239:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787430786.639260:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:10276:x1874256841433344:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787430786.639277:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430786.639296:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145a7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.639362:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.639371:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430786.639375:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430786.639380:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.639411:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.639424:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430786.639438:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6685:1874256856141056:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430786.639547:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430786.647500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430786.648181:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6685:1874256856141056:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430786.648219:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430786.648238:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b800, rc 0) 00000100:00100000:2.0:1787430786.648411:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:10276:x1874256841433344:12345-192.168.204.60@tcp:101:bash.0 Request processed in 9162us (9400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430786.648421:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:1.0:1787430786.648519:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841433472 00000100:00100000:1.0:1787430786.648526:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841433472 00010000:00010000:1.0:1787430786.648561:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430786.648599:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:1.0:1787430786.648609:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841433472:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430786.648622:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430786.648643:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.648657:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.648680:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6909c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a0 expref: 8 pid: 6686 timeout: 350 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.648695:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430786.648699:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430786.648706:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.648716:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.648779:0:11667:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430786.648794:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11667:1874256856141184:192.168.204.60@tcp:105: 00000100:00100000:1.0:1787430786.648846:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430786.658113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.658411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841433728 00000100:00100000:3.0:1787430786.658421:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841433728 00000100:00100000:3.0:1787430786.658474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:3.0:1787430786.658485:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10276:x1874256841433728:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:3.0:1787430786.658812:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10276:x1874256841433728:12345-192.168.204.60@tcp:35:bash.0 Request processed in 328us (709us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787430786.658820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787430786.660197:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11667:1874256856141184:192.168.204.60@tcp:105: 00010000:00010000:2.0:1787430786.660222:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430786.660298:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841433472:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 11690us (12806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430786.660307:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:1.0:1787430786.813396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.813481:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841433984 00000100:00100000:3.0:1787430786.813491:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841433984 00000100:00100000:3.0:1787430786.813556:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:3.0:1787430786.813569:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10286:x1874256841433984:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430786.813594:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430786.813613:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e690aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145ae expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430786.813746:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787430786.813874:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e690aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ae expref: 15 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.813888:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:3.0:1787430786.813891:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430786.813897:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e690aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ae expref: 15 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.813914:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b600, rc 0) 00000100:00100000:3.0:1787430786.813980:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10286:x1874256841433984:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 414us (594us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787430786.813988:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:3.0:1787430786.820689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430786.820849:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841434240 00000100:00100000:2.0:1787430786.820859:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841434240 00000100:00100000:2.0:1787430786.820921:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430786.820940:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10286:x1874256841434240:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430786.821237:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10286:x1874256841434240:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 307us (558us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787430786.821255:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:0.0:1787430786.916464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430786.916826:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841434368 00000100:00100000:1.0:1787430786.916836:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841434368 00000100:00100000:1.0:1787430786.916898:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:1.0:1787430786.916909:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10292:x1874256841434368:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430786.916934:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430786.916955:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e690b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.917025:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e690bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.917039:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e690bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.917050:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e690bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430786.917936:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787430786.917941:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430786.917966:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e690bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.918009:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e690b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145b5 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.918027:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e690bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145b5 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.918036:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430786.918039:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430786.918042:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4400, rc 0) 00000100:00100000:1.0:1787430786.918154:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10292:x1874256841434368:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1246us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430786.918161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:0.0:1787430786.925008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.925112:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841434624 00000100:00100000:3.0:1787430786.925122:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841434624 00000100:00100000:3.0:1787430786.925216:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787430786.925228:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10292:x1874256841434624:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430786.925248:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430786.925267:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e690c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145bc expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.925398:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e690cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.925413:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e690cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.925424:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e690cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430786.925436:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787430786.925566:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e690c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145bc expref: 19 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.925588:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e690cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145bc expref: 18 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.925596:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:3.0:1787430786.925611:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430786.925615:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430786.925673:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10292:x1874256841434624:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 447us (675us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787430786.925680:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:2.0:1787430786.928993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430786.929082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430786.929183:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435008 00000100:00100000:3.0:1787430786.929192:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435008 00000100:00100000:3.0:1787430786.929252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:3.0:1787430786.929264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10292:x1874256841435008:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430786.929286:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430786.929306:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e690db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145c3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.929451:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e690e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.929465:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e690e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.929475:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e690e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430786.929488:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787430786.929604:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e690db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145c3 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.929624:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e690e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145c3 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430786.929643:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:3.0:1787430786.929646:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787430786.929649:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a800, rc 0) 00000100:00100000:3.0:1787430786.929713:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:10292:x1874256841435008:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 452us (630us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787430786.929720:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:1.0:1787430786.938081:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841434752 00000100:00100000:1.0:1787430786.938096:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841434752 00000100:00100000:0.0:1787430786.938267:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787430786.938278:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:2371:x1874256841434752:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430786.938294:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430786.938318:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e690cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145bc expref: 20 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.938369:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:0.0:1787430786.938374:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430786.938439:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:2371:x1874256841434752:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 162us (9455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430786.938459:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:2.0:1787430786.945717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430786.946027:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435136 00000100:00100000:1.0:1787430786.946038:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435136 00000100:00100000:1.0:1787430786.946108:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:1.0:1787430786.946119:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841435136:12345-192.168.204.60@tcp:1:lfs.0 00010000:00010000:1.0:1787430786.946163:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.946183:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.946191:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430786.946194:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430786.946212:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.946259:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430786.946273:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 7 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430786.946287:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874256856141312:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430786.946407:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430786.952265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430786.952362:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435264 00000100:00100000:0.0:1787430786.952371:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435264 00002000:00100000:0.0:1787430786.952416:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa0f2fe631c00 x1874256841435264/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:7/0 lens 504/0 e 0 to 0 dl 1787430797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430786.952427:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe631c00 with x1874256841435264 ext(0->12) 00010000:00010000:0.0:1787430786.952436:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 8 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430786.952452:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 8 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430786.952460:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fe631c00 00000100:00100000:0.0:1787430786.952494:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:0.0:1787430786.952506:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841435264:12345-192.168.204.60@tcp:4:lfs.0 00000100:00100000:1.0:1787430786.953830:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874256856141312:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430786.953854:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787430787.006802:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000100:00100000:2.0:1787430787.008048:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841435264:12345-192.168.204.60@tcp:4:lfs.0 Request processed in 55538us (55786us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787430787.008075:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00002000:00100000:2.0:1787430787.008088:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa0f2fe631c00 x1874256841435264/t4294967299(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:7/0 lens 504/448 e 0 to 0 dl 1787430797 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430787.008099:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe631c00 with x1874256841435264 ext(0->12) 00010000:00010000:2.0:1787430787.008109:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 9 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.008126:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 9 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430787.008134:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fe631c00 00000100:00100000:3.0:1787430787.012072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430787.012450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435392 00000100:00100000:1.0:1787430787.012460:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435392 00010000:00010000:1.0:1787430787.012500:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 9 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430787.012845:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:1.0:1787430787.012857:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2373:x1874256841435392:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430787.012874:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787430787.012895:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787430787.012897:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787430786 00002000:00010000:1.0:1787430787.012900:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787430786 00002000:00010000:1.0:1787430787.012915:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787430786 00010000:00010000:1.0:1787430787.012923:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 9 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430787.012937:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 9 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430787.012959:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000216d78a6/0x1fa5b1e070e690a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145a7 expref: 9 pid: 6685 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430787.012976:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430787.012980:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430787.012985:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430787.012995:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430787.013028:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430787.013093:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841435392:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 237us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430787.013100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 36 00010000:00010000:3.0:1787430787.013159:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013170:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013196:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013205:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013212:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013219:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430787.013230:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013249:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013263:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.013271:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e690f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430787.013316:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841435136:12345-192.168.204.60@tcp:1:lfs.0 Request processed in 67199us (67608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430787.013323:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:0.0:1787430787.020154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430787.020408:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435648 00000100:00100000:2.0:1787430787.020417:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435648 00000100:00100000:2.0:1787430787.020505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430787.020517:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10292:x1874256841435648:12345-192.168.204.60@tcp:35:lfs.0 00000004:00010000:2.0:1787430787.020584:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e690e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145c3 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430787.020867:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787430787.021305:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787430787.022007:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787430787.022083:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.022100:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.022109:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.022154:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.022169:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 23 pid: 5837 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430787.022183:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874256856141440:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430787.026081:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7fc66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430787.030513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.031175:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435776 00000100:00100000:3.0:1787430787.031185:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435776 00010000:00010000:3.0:1787430787.031225:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 24 pid: 5837 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430787.031275:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:3.0:1787430787.031286:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:2374:x1874256841435776:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430787.031302:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430787.031309:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 24 pid: 5837 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.031323:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 24 pid: 5837 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.031398:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:3.0:1787430787.031404:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.031413:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.031419:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.031438:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430787.031492:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:2374:x1874256841435776:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 207us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430787.031500:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00010000:00010000:2.0:1787430787.032447:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14599 expref: 23 pid: 5837 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430787.032481:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874256856141440:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430787.032502:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.032510:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.032516:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430787.032627:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787430787.032812:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787430787.033286:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856141568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430787.033512:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430787.033770:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430787.035108:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856141568 00000100:00100000:0.0:1787430787.035119:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856141568 00000100:00080000:2.0:1787430787.035191:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430787.035749:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430787.035762:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856141568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787430787.035886:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856141568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 127us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430787.035892:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430787.035993:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe630000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856141568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787430787.036688:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787430787.036763:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856141696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430787.036808:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430787.040564:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430787.040622:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856141696 00000100:00100000:1.0:1787430787.040631:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856141696 00000100:00100000:1.0:1787430787.040676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430787.040686:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856141696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787430787.041150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874256856141696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 464us (4340us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787430787.041157:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430787.041354:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856141696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787430787.041424:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787430787.041469:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.041490:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.041497:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.041503:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430787.041507:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.041515:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.041530:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:3.0:1787430787.041533:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787430787.041537:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.041544:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e690f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430787.041746:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787430787.042080:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787430787.042092:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 250596764412ns, next at 251596762554ns, rc = 0 00000001:00080000:3.0:1787430787.042099:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787430787.042131:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2daf05c00) 00010000:00010000:3.0:1787430787.042135:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787430787.042141:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e690e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145c3 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430787.042415:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:10292:x1874256841435648:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 21899us (22269us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787430787.042424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000020:00080000:3.0:1787430787.042428:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787430787.045505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430787.045686:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841435904 00000100:00100000:2.0:1787430787.045696:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841435904 00000100:00100000:2.0:1787430787.045760:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:2.0:1787430787.045769:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:10292:x1874256841435904:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430787.045794:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430787.045816:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e690fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145ca expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.045878:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e690fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ca expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.045893:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e690fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ca expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.045941:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430787.045944:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430787.045948:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74000, rc 0) 00000100:00100000:2.0:1787430787.046006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:10292:x1874256841435904:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 237us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430787.046013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:1.0:1787430787.051886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.052028:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841436160 00000100:00100000:3.0:1787430787.052037:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841436160 00000100:00100000:3.0:1787430787.052153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787430787.052164:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:10292:x1874256841436160:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430787.052427:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:10292:x1874256841436160:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 264us (549us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787430787.052434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00010000:00010000:1.0:1787430787.100493:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430787.215157:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.215251:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841436416 00000100:00100000:3.0:1787430787.215260:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841436416 00000100:00100000:3.0:1787430787.215320:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:3.0:1787430787.215379:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:10302:x1874256841436416:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430787.215404:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430787.215426:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145d1 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430787.215551:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787430787.215669:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69105 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d1 expref: 30 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.215682:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:3.0:1787430787.215685:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430787.215700:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d1 expref: 30 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.215714:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a800, rc 0) 00000100:00100000:3.0:1787430787.215775:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10302:x1874256841436416:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 446us (628us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787430787.215782:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:1.0:1787430787.219290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430787.219388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841436544 00000100:00100000:0.0:1787430787.219397:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841436544 00000100:00100000:0.0:1787430787.219462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:0.0:1787430787.219473:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10302:x1874256841436544:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:0.0:1787430787.219546:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219561:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219572:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219588:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219602:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219611:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219701:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219708:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219714:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430787.219758:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219769:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219780:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219787:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219792:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430787.219796:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219802:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219813:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430787.219815:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430787.219819:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219824:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219839:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219844:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219849:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219854:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430787.219870:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219876:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219883:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430787.219885:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430787.219887:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219893:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6911a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219913:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219918:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219923:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219928:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430787.219930:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219935:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219942:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430787.219944:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430787.219953:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.219959:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430787.220507:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10302:x1874256841436544:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 1034us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430787.220516:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:2.0:1787430787.233307:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.233831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841436800 00000100:00100000:3.0:1787430787.233842:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841436800 00000100:00100000:2.0:1787430787.234128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:2.0:1787430787.234140:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10302:x1874256841436800:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430787.234472:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:10302:x1874256841436800:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 333us (1174us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787430787.234480:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787430787.285106:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430787.287372:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841437056 00000100:00100000:0.0:1787430787.287386:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841437056 00000100:00100000:0.0:1787430787.287529:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:0.0:1787430787.287541:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:10305:x1874256841437056:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430787.287566:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430787.287587:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145d8 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287667:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287681:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287691:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287712:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287719:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287743:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287868:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287877:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.287884:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430787.287893:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787430787.288003:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288011:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288018:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288024:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430787.288028:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288035:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288046:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430787.288303:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430787.288316:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288323:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6912f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288364:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288371:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288377:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288383:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430787.288386:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288392:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288400:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430787.288403:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430787.288406:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288411:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288453:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 33 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288481:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 32 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.288488:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430787.288491:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430787.288493:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263200, rc 0) 00000100:00100000:0.0:1787430787.288620:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10305:x1874256841437056:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1080us (3522us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787430787.288627:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:2.0:1787430787.292786:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856141824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430787.292852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430787.293009:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856141824 00000100:00100000:3.0:1787430787.293017:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856141824 00000100:00100000:3.0:1787430787.293077:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787430787.293088:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856141824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430787.293110:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430787.297734:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856141824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4637us (4870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430787.297748:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787430787.297874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.298035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841437184 00000100:00100000:3.0:1787430787.298044:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841437184 00000100:00100000:3.0:1787430787.298104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:3.0:1787430787.298112:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10305:x1874256841437184:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:3.0:1787430787.298174:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298190:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298201:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298242:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298249:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298255:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298271:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430787.298276:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298284:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298296:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:3.0:1787430787.298299:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430787.298304:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430787.298310:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6914b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430787.298391:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10305:x1874256841437184:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 279us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430787.298398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:1.0:1787430787.308572:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.308719:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841437440 00000100:00100000:3.0:1787430787.308728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841437440 00000100:00100000:3.0:1787430787.308780:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:3.0:1787430787.308802:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10305:x1874256841437440:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430787.309043:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:10305:x1874256841437440:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 241us (480us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787430787.309062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787430787.311887:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856141824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430787.852746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430787.852837:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841437696 00000100:00100000:0.0:1787430787.852994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841437696 00000100:00100000:0.0:1787430787.853080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:0.0:1787430787.853091:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feeddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:10337:x1874256841437696:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:0.0:1787430787.853115:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430787.853135:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.853251:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.853263:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.853275:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430787.853286:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787430787.853482:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145df expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.853505:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145df expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430787.853513:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430787.853516:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430787.853519:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263a00, rc 0) 00000100:00100000:0.0:1787430787.853576:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feeddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10337:x1874256841437696:12345-192.168.204.60@tcp:101:cat.0 Request processed in 487us (841us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787430787.853583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:1.0:1787430787.862763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430787.862845:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841437952 00000100:00100000:3.0:1787430787.862854:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841437952 00000100:00100000:3.0:1787430787.862928:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:3.0:1787430787.862939:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10337:x1874256841437952:12345-192.168.204.60@tcp:35:cat.0 00000100:00100000:3.0:1787430787.863215:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:10337:x1874256841437952:12345-192.168.204.60@tcp:35:cat.0 Request processed in 276us (460us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787430787.863232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:1.0:1787430787.873056:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430787.874644:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841438080 00000100:00100000:2.0:1787430787.874657:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841438080 00000100:00100000:2.0:1787430787.874747:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:2.0:1787430787.874757:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:2371:x1874256841438080:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430787.874771:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430787.874794:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145df expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430787.874838:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430787.875732:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430787.875840:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:2371:x1874256841438080:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 1082us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430787.875857:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:1.0:1787430787.999541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430788.000086:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841438336 00000100:00100000:3.0:1787430788.000096:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841438336 00000100:00100000:3.0:1787430788.000158:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:3.0:1787430788.000168:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10343:x1874256841438336:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787430788.000193:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430788.000196:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787430788.000220:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e690bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145b5 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.000240:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430788.000245:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430788.000258:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69167 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145e6 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.000418:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.000453:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 35 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.000462:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.000497:0:6884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 35 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.000510:0:6884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 35 pid: 6884 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430788.000523:0:6884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6884:1874256856141952:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430788.000611:0:6884:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430788.009236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430788.009359:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841438464 00000100:00100000:1.0:1787430788.009369:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841438464 00010000:00010000:1.0:1787430788.009423:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 36 pid: 6884 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430788.010131:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:1.0:1787430788.010143:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:2374:x1874256841438464:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430788.010159:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430788.010167:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 36 pid: 6884 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.010182:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 36 pid: 6884 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.010216:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430788.010222:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.010232:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.010240:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.010258:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430788.010312:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:2374:x1874256841438464:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 172us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430788.010320:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00080000:2.0:1787430788.011226:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430788.012131:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6913d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145d8 expref: 35 pid: 6884 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430788.012155:0:6884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6884:1874256856141952:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430788.012180:0:6884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.012190:0:6884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.012195:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430788.012214:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787430788.018365:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69167 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 36 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.018395:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 35 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.018405:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:3.0:1787430788.018409:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430788.018412:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430788.018491:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10343:x1874256841438336:12345-192.168.204.60@tcp:101:dd.0 Request processed in 18324us (18958us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787430788.018501:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787430788.024115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430788.027412:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841438720 00000100:00100000:1.0:1787430788.027427:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841438720 00000100:00100000:1.0:1787430788.027499:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:1.0:1787430788.027512:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10343:x1874256841438720:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:1.0:1787430788.027786:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.027802:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.027812:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430788.027860:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787430788.027887:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5eb0fd4 reply state 00000000917b424f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430788.027907:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430788.028022:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:10343:x1874256841438720:12345-192.168.204.60@tcp:36:dd.0 Request processed in 512us (3914us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787430788.028029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000020:00080000:1.0:1787430788.028033:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787430788.036139:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.036155:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.036164:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.036169:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430788.036173:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.036180:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.036195:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430788.036198:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430788.036215:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.036221:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6917c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430788.125507:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430788.319290:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856142464:0@lo:400:kworker.0 00000100:00100000:3.0:1787430788.319376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430788.319436:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430788.319443:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856142336:0@lo:400:kworker.0 00000100:00100000:3.0:1787430788.319469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430788.319499:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142336 00000100:00100000:3.0:1787430788.319508:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142336 00000100:00080000:3.0:1787430788.319535:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430788.319548:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430788.319555:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856142848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430788.319573:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787430788.319582:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856142336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430788.319583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430788.319613:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142848 00000100:00100000:1.0:1787430788.319616:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142848 00000100:00100000:3.0:1787430788.319629:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856142336:12345-0@lo:400:kworker.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430788.319636:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787430788.319648:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787430788.319655:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856142848:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787430788.319666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787430788.319682:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430788.319712:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856142848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430788.319720:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787430788.319743:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856142208:0@lo:400:kworker.0 00000100:00100000:1.0:1787430788.319761:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856142848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430788.319770:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430788.319773:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856142336:0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.319796:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856142720:0@lo:400:kworker.0 00000100:00100000:1.0:1787430788.319810:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142464 00000100:00100000:1.0:1787430788.319813:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142464 00000100:00100000:0.0:1787430788.319815:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430788.319830:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787430788.319835:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856142080:0@lo:400:kworker.0 00000100:00100000:1.0:1787430788.319836:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142720 00000100:00100000:1.0:1787430788.319838:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142720 00000100:00100000:1.0:1787430788.319855:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430788.319859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430788.319860:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856142464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.319879:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856142592:0@lo:400:kworker.0 00000100:00100000:1.0:1787430788.319891:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856142464:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430788.319896:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430788.319927:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142080 00000100:00100000:0.0:1787430788.319931:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142080 00000100:00100000:0.0:1787430788.319956:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787430788.319962:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856142080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856142080:12345-0@lo:400:kworker.0 Request processed in 42us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430788.320010:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787430788.320052:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856142080:0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320068:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142208 00000100:00100000:0.0:1787430788.320071:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142208 00000100:00100000:0.0:1787430788.320087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856142592 00000100:00100000:0.0:1787430788.320089:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856142592 00000100:00100000:0.0:1787430788.320108:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787430788.320118:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856142208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320147:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856142208:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430788.320152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787430788.320162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787430788.320167:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856142592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320186:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856142592:12345-0@lo:400:kworker.0 Request processed in 19us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430788.320191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787430788.320201:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430788.320214:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856142592:0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320223:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856142208:0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320251:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430788.320258:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856142720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320285:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856142720:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430788.320290:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430788.320312:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856142720:0@lo:400:kworker.0 00000100:00100000:0.0:1787430788.320365:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856142464:0@lo:400:kworker.0 00000100:00100000:1.0:1787430788.322004:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787430788.567391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430788.568106:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841438848 00000100:00100000:3.0:1787430788.568128:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841438848 00000100:00100000:3.0:1787430788.568193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:3.0:1787430788.568204:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:10357:x1874256841438848:12345-192.168.204.60@tcp:101:stat.0 00010000:00010000:3.0:1787430788.568228:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430788.568248:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145ed expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568314:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568352:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568366:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568383:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568390:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568397:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568493:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568504:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 38 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568511:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568549:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 38 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430788.568562:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 38 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430788.568576:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856142976:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430788.568927:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430788.576765:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe889180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856142976:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430788.576799:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430788.579173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430788.580509:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841439104 00000100:00100000:3.0:1787430788.580521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841439104 00000100:00100000:3.0:1787430788.581119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787430788.581133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:5605:x1874256841439104:12345-192.168.204.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787430788.582291:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:5605:x1874256841439104:12345-192.168.204.60@tcp:35:ldlm_bl.0 Request processed in 1159us (3122us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787430788.582302:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:1.0:1787430788.587726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430788.589160:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841439232 00000100:00100000:0.0:1787430788.589171:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841439232 00010000:00010000:0.0:1787430788.589211:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 40 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430788.590068:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:0.0:1787430788.590095:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:2374:x1874256841439232:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430788.590109:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430788.590117:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 40 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.590131:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 40 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.590151:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e6916e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145e6 expref: 40 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.590168:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430788.590173:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.590182:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.590190:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.590552:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430788.590611:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:2374:x1874256841439232:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 519us (2893us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430788.592171:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592183:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430788.592232:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787430788.592238:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430788.592283:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592297:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592306:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592313:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592319:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592339:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430788.592344:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592352:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592378:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430788.592380:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430788.592384:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592391:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6918a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592405:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.592411:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593110:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593119:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430788.593123:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593129:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593138:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2daf05c00) 00010000:00010000:1.0:1787430788.593141:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430788.593144:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593151:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593207:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ed expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593222:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ed expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430788.593229:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430788.593230:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430788.593233:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147ae00, rc 0) 00000100:00100000:1.0:1787430788.593458:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:10357:x1874256841438848:12345-192.168.204.60@tcp:101:stat.0 Request processed in 25254us (26075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430788.593466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:0.0:1787430788.594149:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:1.0:1787430788.743553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430788.744092:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841439488 00000100:00100000:0.0:1787430788.744102:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841439488 00000100:00100000:0.0:1787430788.744161:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:0.0:1787430788.744172:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:10363:x1874256841439488:12345-192.168.204.60@tcp:36:truncate.0 00010000:00010000:0.0:1787430788.744244:0:9043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430788.744269:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ed expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.744289:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430788.744293:0:9043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430788.744552:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.744564:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.744574:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430788.744621:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787430788.744646:0:9043:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b6f7ef6 reply state 00000000d858018d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430788.744654:0:9043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430788.744763:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:10363:x1874256841439488:12345-192.168.204.60@tcp:36:truncate.0 Request processed in 593us (1218us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787430788.744770:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00000020:00080000:0.0:1787430788.744775:0:9043:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787430788.753178:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.753195:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.753273:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.753294:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430788.753299:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.753307:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.753323:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430788.753346:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430788.753351:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430788.753357:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e6919f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430789.050030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430789.050104:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841439616 00000100:00100000:3.0:1787430789.050114:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841439616 00000100:00100000:3.0:1787430789.050238:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:3.0:1787430789.050250:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:10377:x1874256841439616:12345-192.168.204.60@tcp:101:stat.0 00010000:00010000:3.0:1787430789.050272:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430789.050292:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e691a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145f4 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050403:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050425:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050435:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050450:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050456:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050461:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050553:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050561:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050567:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430789.050602:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787430789.050607:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430789.050630:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050651:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050659:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050664:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050670:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050676:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430789.050680:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050686:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050698:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430789.050700:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430789.050704:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050710:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e691ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050726:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050732:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050743:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050748:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430789.050750:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050756:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050764:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430789.050766:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430789.050768:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050773:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e691b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050804:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e691a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 41 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050819:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 40 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.050825:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:3.0:1787430789.050826:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430789.050828:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a800, rc 0) 00000100:00100000:3.0:1787430789.050898:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:10377:x1874256841439616:12345-192.168.204.60@tcp:101:stat.0 Request processed in 642us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430789.050912:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00010000:00010000:3.0:1787430789.151524:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430789.180430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430789.180530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841439872 00000100:00100000:1.0:1787430789.180540:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841439872 00000100:00100000:1.0:1787430789.180604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:1.0:1787430789.180614:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:10387:x1874256841439872:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430789.180634:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430789.180655:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e691c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc145fb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430789.180769:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787430789.180889:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e691c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145fb expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.180903:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:1.0:1787430789.180919:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430789.180925:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e691c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145fb expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.180939:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5000, rc 0) 00000100:00100000:1.0:1787430789.180996:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+41:10387:x1874256841439872:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 383us (575us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787430789.181003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:2.0:1787430789.193841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.194360:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841440128 00000100:00100000:0.0:1787430789.194370:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841440128 00000100:00100000:0.0:1787430789.195004:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787430789.195036:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+41:10387:x1874256841440128:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787430789.195318:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+42:10387:x1874256841440128:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 304us (1491us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787430789.195356:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:2.0:1787430789.324869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430789.324939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841440384 00000100:00100000:1.0:1787430789.324949:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841440384 00000100:00100000:1.0:1787430789.325067:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:1.0:1787430789.325078:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+42:10393:x1874256841440384:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430789.325100:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430789.325120:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e691d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14602 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.325227:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.325242:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 43 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.325250:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.325282:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 43 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.325295:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 43 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430789.325322:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856143104:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430789.325453:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95c4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430789.332710:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f73cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856143104:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430789.332741:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430789.333495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430789.333572:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841440512 00000100:00100000:1.0:1787430789.333579:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841440512 00010000:00010000:1.0:1787430789.333612:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 44 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430789.333646:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:1.0:1787430789.333656:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+44:2374:x1874256841440512:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430789.333670:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430789.333677:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 44 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.333690:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 44 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.333710:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e691bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145f4 expref: 44 pid: 6884 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.333728:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430789.333733:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.333754:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.333761:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.333835:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430789.333890:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:2374:x1874256841440512:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 235us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430789.333906:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00010000:00010000:0.0:1787430789.336033:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.336048:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430789.336072:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787430789.338053:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e691d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.338083:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.338095:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430789.338098:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787430789.338101:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4c00, rc 0) 00000100:00100000:0.0:1787430789.339080:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:10393:x1874256841440384:12345-192.168.204.60@tcp:101:bash.0 Request processed in 14001us (14217us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787430789.339092:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:3.0:1787430789.345382:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.345494:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841440768 00000100:00100000:0.0:1787430789.345505:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841440768 00000100:00100000:0.0:1787430789.345563:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:0.0:1787430789.345574:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:10393:x1874256841440768:12345-192.168.204.60@tcp:36:bash.0 00010000:00010000:0.0:1787430789.345830:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.345847:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.345859:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430789.345910:0:6884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787430789.345936:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d551f709 reply state 000000004150d749 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430789.345946:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430789.346072:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+46:10393:x1874256841440768:12345-192.168.204.60@tcp:36:bash.0 Request processed in 499us (700us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787430789.346080:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00000020:00080000:0.0:1787430789.346085:0:6884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787430789.352743:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.352761:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.352770:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.352777:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430789.352782:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.352789:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.352807:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:3.0:1787430789.352810:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430789.352815:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430789.352822:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e691e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430789.362384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.362586:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841440896 00000100:00100000:0.0:1787430789.362596:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841440896 00000100:00100000:0.0:1787430789.362660:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:0.0:1787430789.362673:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:10393:x1874256841440896:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430789.362698:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430789.362718:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e691ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14609 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.362826:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.362840:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.362848:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.362880:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.362893:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 46 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430789.362907:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe6dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856143232:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430789.363049:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c531da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430789.372080:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe6dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856143232:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430789.372115:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430789.373115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.373324:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841441024 00000100:00100000:0.0:1787430789.373358:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841441024 00010000:00010000:0.0:1787430789.374231:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 47 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430789.374280:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:0.0:1787430789.374294:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:2373:x1874256841441024:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430789.374309:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430789.374316:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 47 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.374586:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 47 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.374612:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e691d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14602 expref: 47 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.374631:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430789.374637:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.374646:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.374653:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.375347:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430789.376108:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+46:2373:x1874256841441024:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 1812us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430789.376120:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00010000:00010000:0.0:1787430789.376359:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.376369:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430789.376437:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787430789.376443:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430789.376474:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.376511:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e691ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14609 expref: 46 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.376534:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14609 expref: 45 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.376543:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430789.376545:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430789.376548:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262000, rc 0) 00000100:00100000:0.0:1787430789.376582:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:10393:x1874256841440896:12345-192.168.204.60@tcp:101:bash.0 Request processed in 13914us (14208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430789.376590:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:2.0:1787430789.383688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430789.384081:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841441280 00000100:00100000:3.0:1787430789.384090:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841441280 00000100:00100000:3.0:1787430789.384150:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430789.384172:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:10393:x1874256841441280:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:2.0:1787430789.386363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+46:10393:x1874256841441280:12345-192.168.204.60@tcp:35:bash.0 Request processed in 2184us (2675us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787430789.386376:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430789.550921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.551082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841441536 00000100:00100000:0.0:1787430789.551091:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841441536 00000100:00100000:0.0:1787430789.551194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:0.0:1787430789.551207:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+46:10403:x1874256841441536:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430789.551241:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430789.551277:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e691fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14610 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430789.552236:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787430789.552422:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e691fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14610 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.552438:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:0.0:1787430789.552441:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430789.552446:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e691fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14610 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.552464:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263c00, rc 0) 00000100:00100000:0.0:1787430789.552704:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10403:x1874256841441536:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1499us (1790us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787430789.552713:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:1.0:1787430789.562926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430789.564058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841441664 00000100:00100000:2.0:1787430789.564069:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841441664 00000100:00100000:2.0:1787430789.564362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:2.0:1787430789.564374:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10403:x1874256841441664:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:2.0:1787430789.565266:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565283:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565297:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565312:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565320:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565367:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565632:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565642:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565649:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430789.565692:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565704:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565720:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565727:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565734:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430789.565738:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565745:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565757:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430789.565760:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430789.565765:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565771:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565785:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565792:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565797:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565802:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430789.565811:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565817:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565826:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d22f0800) 00010000:00010000:2.0:1787430789.565828:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430789.565831:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565837:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6920f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565851:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565856:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565863:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565868:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430789.565870:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565876:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565882:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430789.565884:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430789.565895:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.565900:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430789.566681:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10403:x1874256841441664:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 2303us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430789.566691:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:1.0:1787430789.569901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.569984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841441920 00000100:00100000:0.0:1787430789.569994:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841441920 00000100:00100000:0.0:1787430789.570083:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:0.0:1787430789.570095:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10403:x1874256841441920:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787430789.570401:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+48:10403:x1874256841441920:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 308us (507us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787430789.570409:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:3.0:1787430789.658406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.658502:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841442176 00000100:00100000:0.0:1787430789.658512:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841442176 00000100:00100000:0.0:1787430789.658571:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:0.0:1787430789.658581:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+48:10406:x1874256841442176:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430789.658620:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430789.658639:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6921d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14617 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658721:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658750:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658760:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658775:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658781:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658787:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658924:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658933:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.658940:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430789.658951:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787430789.659064:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659071:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659078:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659084:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430789.659088:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659094:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659105:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430789.659109:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430789.659113:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659120:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659135:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659142:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659149:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659153:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430789.659160:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659166:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659173:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430789.659176:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430789.659179:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659186:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6922b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659227:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6921d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14617 expref: 51 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659240:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14617 expref: 50 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.659247:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430789.659250:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430789.659252:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262a00, rc 0) 00000100:00100000:0.0:1787430789.659313:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10406:x1874256841442176:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 733us (916us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787430789.659321:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:3.0:1787430789.663711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430789.663766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430789.663846:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841442304 00000100:00100000:0.0:1787430789.663855:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841442304 00000100:00100000:0.0:1787430789.663922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:0.0:1787430789.663932:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10406:x1874256841442304:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:0.0:1787430789.664031:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664048:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664059:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664083:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664090:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664097:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664102:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430789.664106:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664113:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664124:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430789.664127:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430789.664131:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430789.664138:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430789.664227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10406:x1874256841442304:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 296us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430789.664235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:1.0:1787430789.665399:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841442432 00000100:00100000:1.0:1787430789.665408:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841442432 00000100:00100000:1.0:1787430789.665460:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:1.0:1787430789.665468:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:2374:x1874256841442432:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430789.665482:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430789.665501:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14617 expref: 50 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430789.665517:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430789.665521:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430789.665566:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+49:2374:x1874256841442432:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 98us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430789.665582:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:3.0:1787430789.666852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430789.667484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841442688 00000100:00100000:1.0:1787430789.667493:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841442688 00000100:00100000:1.0:1787430789.667541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:1.0:1787430789.667550:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+49:10406:x1874256841442688:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:1.0:1787430789.667763:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10406:x1874256841442688:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 213us (915us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787430789.667771:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:3.0:1787430789.984152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430789.984662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841442944 00000100:00100000:2.0:1787430789.984673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841442944 00000100:00100000:2.0:1787430789.984853:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:2.0:1787430789.984864:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10424:x1874256841442944:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:2.0:1787430789.984902:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430789.984929:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1461e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.985057:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6924e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.985070:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6924e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.985082:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6924e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430789.985093:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787430789.985406:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1461e expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.985427:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6924e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1461e expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430789.985449:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430789.985452:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787430789.985456:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74e00, rc 0) 00000100:00100000:2.0:1787430789.985521:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:10424:x1874256841442944:12345-192.168.204.60@tcp:101:cat.0 Request processed in 658us (1378us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787430789.985528:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:3.0:1787430790.024984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430790.025474:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841443072 00000100:00100000:0.0:1787430790.025483:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841443072 00000100:00100000:0.0:1787430790.025561:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:0.0:1787430790.025572:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:10425:x1874256841443072:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430790.025595:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430790.025615:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6925c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14625 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.025686:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.025700:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.025711:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787430790.025814:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787430790.026098:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787430790.026103:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430790.026127:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.026158:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6925c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14625 expref: 54 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.026253:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14625 expref: 53 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.026274:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430790.026277:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430790.026280:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263600, rc 0) 00000100:00100000:0.0:1787430790.026441:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+53:10425:x1874256841443072:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 869us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430790.026448:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787430790.032044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430790.032115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841443456 00000100:00100000:0.0:1787430790.032125:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841443456 00000100:00100000:0.0:1787430790.032192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:0.0:1787430790.032202:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+53:10425:x1874256841443456:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787430790.033173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10425:x1874256841443456:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 968us (1211us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787430790.033271:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:2.0:1787430790.035624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430790.035682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841443584 00000100:00100000:1.0:1787430790.035691:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841443584 00000100:00100000:1.0:1787430790.035905:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:1.0:1787430790.035917:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10425:x1874256841443584:12345-192.168.204.60@tcp:103:lfs.0 00010000:00010000:1.0:1787430790.035935:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787430790.035961:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e691f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14609 expref: 54 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.035989:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6924e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1461e expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.036275:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e690fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc145ca expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.036289:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430790.036300:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430790.036404:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10425:x1874256841443584:12345-192.168.204.60@tcp:103:lfs.0 Request processed in 489us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430790.036426:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:1.0:1787430790.039673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430790.039776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841443712 00000100:00100000:2.0:1787430790.039784:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841443712 00000100:00100000:2.0:1787430790.039844:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:2.0:1787430790.039855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10425:x1874256841443712:12345-192.168.204.60@tcp:58:lfs.0 00010000:00010000:2.0:1787430790.040445:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.040462:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.040472:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430790.041137:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430790.045486:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787430790.045576:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787430790.045719:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10425:x1874256841443712:12345-192.168.204.60@tcp:58:lfs.0 Request processed in 5860us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.046610:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:3.0:1787430790.073824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430790.074264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841443840 00000100:00100000:2.0:1787430790.074287:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841443840 00000100:00100000:2.0:1787430790.074379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:2.0:1787430790.074390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10427:x1874256841443840:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430790.074409:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430790.074429:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69271 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1462c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074497:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074510:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074521:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074540:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074547:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074553:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074647:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074655:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074661:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430790.074703:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787430790.074708:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430790.074726:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074751:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074760:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074765:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074771:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074776:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430790.074781:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074788:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074800:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430790.074803:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430790.074808:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074815:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69278 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074841:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074848:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074854:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074859:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430790.074862:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074881:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074890:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430790.074892:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430790.074895:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.074901:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6927f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.075671:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69271 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.075689:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.075708:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:2.0:1787430790.075710:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430790.075713:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74400, rc 0) 00000100:00100000:2.0:1787430790.075795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:10427:x1874256841443840:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1406us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430790.075804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00010000:00010000:1.0:1787430790.172520:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787430790.489868:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:2.0:1787430790.489944:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787430790.489976:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2c34c7f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787430790.489981:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2fe899100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2c34c76c0 00000020:00080000:2.0:1787430790.489985:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2fe899200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2fedba000 00000020:00080000:2.0:1787430790.490021:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787430790.490154:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787430790.490477:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430790.490497:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856143360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787430790.490565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430790.490774:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856143360 00000100:00100000:0.0:1787430790.490783:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856143360 00000100:00100000:0.0:1787430790.490842:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787430790.490851:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856143360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787430790.490877:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00000100:00080000:1.0:1787430790.490889:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787430790.490910:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8a0782, atime: 0x6a8a0782, ctime: 0x6a8a0782, blocks: 0x1 00010000:00010000:0.0:1787430790.490920:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.490936:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=254s v=(0 0) 00010000:00010000:0.0:1787430790.490941:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430790.490948:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.490972:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.490983:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.492485:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.492512:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430790.492694:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430790.492703:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.492714:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430790.492719:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.492731:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.492754:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.492769:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6928d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430790.492792:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430790.492794:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430790.492796:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430790.493044:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874256856143360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2192us (2477us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787430790.493053:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1787430790.494210:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2f7fdf800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787430790.494220:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856143360:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1787430790.880110:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430790.880119:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430790.880186:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787430790.880193:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430790.880314:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856143488:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430790.880434:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430790.891958:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856143488:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787430790.898789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430790.904154:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841443968 00000100:00100000:3.0:1787430790.904182:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841443968 00000100:00100000:3.0:1787430790.904270:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:3.0:1787430790.904284:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841443968:12345-192.168.204.60@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787430790.904414:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841443968:12345-192.168.204.60@tcp:900:lhsmtool_posix.0 Request processed in 135us (5634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.904423:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:0.0:1787430790.913000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430790.914282:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841444096 00000100:00100000:3.0:1787430790.914294:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841444096 00000100:00100000:3.0:1787430790.914381:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:3.0:1787430790.914393:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841444096:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430790.914425:0:6884:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430790.914552:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841444096:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 160us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.914560:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787430790.923385:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430790.926254:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841444224 00000100:00100000:3.0:1787430790.926268:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841444224 00000100:00100000:3.0:1787430790.926384:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787430790.926396:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841444224:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787430790.926483:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926498:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926511:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926526:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926551:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926583:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926591:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926597:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430790.926637:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787430790.926643:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430790.926655:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926666:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926673:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926678:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926684:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430790.926688:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926696:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926715:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:3.0:1787430790.926717:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430790.926722:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926728:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69294 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926740:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926745:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926751:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926755:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430790.926758:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926763:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926771:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430790.926773:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430790.926776:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926781:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e6929b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926806:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926812:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926818:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926823:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430790.926826:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926832:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926840:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:3.0:1787430790.926842:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430790.926845:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430790.926851:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430790.926932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841444224:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 Request processed in 538us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430790.926941:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787430790.955959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430790.956134:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841444480 00000100:00100000:0.0:1787430790.956144:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841444480 00000100:00100000:0.0:1787430790.956212:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:0.0:1787430790.956223:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:10438:x1874256841444480:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430790.956245:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430790.956267:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e692a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14633 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956409:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956440:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956452:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430790.956464:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787430790.956654:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956664:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956671:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956677:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430790.956696:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956705:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956717:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:0.0:1787430790.956721:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430790.956726:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956732:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956778:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e692a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14633 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956796:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:0.0:1787430790.956799:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430790.956803:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e692a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14633 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430790.956813:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263400, rc 0) 00000100:00100000:0.0:1787430790.957294:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841444480:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1069us (1341us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787430790.957303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:3.0:1787430790.960841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430790.968557:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841444608 00000100:00100000:0.0:1787430790.968573:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841444608 00000100:00100000:0.0:1787430790.968671:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:0.0:1787430790.968683:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841444608:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430790.968721:0:9043:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430790.968847:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841444608:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 166us (8014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430790.968866:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:1.0:1787430790.982388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430790.982425:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841444864 00000100:00100000:1.0:1787430790.982434:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841444864 00000100:00100000:1.0:1787430790.982497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:1.0:1787430790.982626:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841444864:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430790.982645:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430790.982648:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787430790.982673:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14625 expref: 12 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.982692:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430790.982898:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430790.982915:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e692be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1463a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787430790.988670:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787430790.990349:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e692c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.991053:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e692c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.991080:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e692c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.991157:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e692be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1463a expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.991175:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e692c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1463a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430790.991184:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:1.0:1787430790.991187:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430790.991190:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4a00, rc 0) 00000100:00100000:1.0:1787430790.991258:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841444864:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 8636us (8877us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787430790.991267:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:0.0:1787430791.007565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.007948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841445120 00000100:00100000:3.0:1787430791.007964:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841445120 00000100:00100000:3.0:1787430791.008030:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:3.0:1787430791.008041:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841445120:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787430791.008102:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430791.008125:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e692c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1463a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008142:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d0ce5d00) 00010000:00010000:3.0:1787430791.008152:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430791.008177:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008191:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008200:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008211:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008217:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008223:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008955:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008966:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008991:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.008997:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430791.009001:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009009:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009019:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430791.009022:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430791.009026:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009032:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e692d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009045:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009052:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009058:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009063:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430791.009066:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009081:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009089:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x48c8a0fc (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430791.009092:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430791.009094:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.009100:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e692da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x48c8a0fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.009196:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841445120:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 1155us (1637us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430791.009205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:3.0:1787430791.020250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430791.020440:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841445248 00000100:00100000:2.0:1787430791.020451:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841445248 00000100:00100000:2.0:1787430791.020515:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:2.0:1787430791.020526:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841445248:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430791.020545:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430791.020567:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e692e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14641 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.020605:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.020617:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.020628:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.021109:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e692e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 14 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.021129:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 13 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.021144:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430791.021147:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430791.021151:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75400, rc 0) 00000100:00100000:2.0:1787430791.021211:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841445248:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 687us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430791.021219:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:2.0:1787430791.028730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.029056:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841445504 00000100:00100000:0.0:1787430791.029065:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841445504 00000100:00100000:0.0:1787430791.029125:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:0.0:1787430791.029135:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841445504:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430791.029223:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.029257:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.029269:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430791.029645:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787430791.029656:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 254584328551ns, next at 255584325431ns, rc = 0 00000004:00010000:0.0:1787430791.030114:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c0c82f7 reply state 000000006a4fa198 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430791.030125:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430791.030230:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10438:x1874256841445504:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 1094us (1508us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787430791.030238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00010000:00010000:2.0:1787430791.034053:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.034071:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.034079:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.034085:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430791.034090:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.034098:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.034116:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:2.0:1787430791.034119:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430791.034123:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.034130:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e692ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430791.036673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.037906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841445632 00000100:00100000:0.0:1787430791.037919:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841445632 00000100:00100000:0.0:1787430791.038065:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:0.0:1787430791.038079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10438:x1874256841445632:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430791.038103:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430791.038124:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14648 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.038181:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.038195:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.038228:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430791.038231:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430791.038235:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263c00, rc 0) 00000100:00100000:0.0:1787430791.038298:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10438:x1874256841445632:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 222us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430791.038305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:0.0:1787430791.043175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430791.043304:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841445760 00000100:00100000:2.0:1787430791.043313:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841445760 00000100:00100000:2.0:1787430791.043376:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:2.0:1787430791.043385:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1874256841445760:12345-192.168.204.60@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787430791.044132:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1787430791.044172:0:6685:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e692fd 00002000:00100000:2.0:1787430791.044183:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 711a801a-27eb-4d09-8ae0-8dc5ece71a10/ffffa0f2c9f17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430791.044206:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787430791.044464:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787430791.046647:0:6685:0:(import.c:65:import_set_state_nolock()) ffffa0f2c9f14800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430791.047099:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841445760:12345-192.168.204.60@tcp:8:lhsmtool_posix.0 Request processed in 3709us (3928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.047111:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:0.0:1787430791.065582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.071109:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841445888 00000100:00100000:1.0:1787430791.071123:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841445888 00000100:00080000:1.0:1787430791.072049:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430791.072148:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:0.0:1787430791.072161:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:0:x1874256841445888:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1787430791.200017:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430791.211166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.211211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.211242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.213102:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841446272 00000100:00100000:3.0:1787430791.213116:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841446272 00000100:00100000:3.0:1787430791.213207:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:3.0:1787430791.213219:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841446272:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430791.213297:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841446272:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 80us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.213304:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:3.0:1787430791.213346:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841446144 00000100:00100000:3.0:1787430791.213351:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841446144 00000100:00100000:3.0:1787430791.213391:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:3.0:1787430791.213397:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841446144:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430791.213425:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841446144:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.213432:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00080000:1.0:1787430791.214785:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430791.214793:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430791.228235:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841446016 00000100:00100000:2.0:1787430791.228248:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841446016 00000100:00100000:2.0:1787430791.228319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 267 00000100:00100000:2.0:1787430791.228359:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841446016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430791.228438:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841446016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (17226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430791.228446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 267 00000001:00080000:2.0:1787430791.290759:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1787430791.290791:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000100:00100000:0.0:1787430791.291933:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:0:x1874256841445888:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 219766us (226349us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787430791.291944:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:3.0:1787430791.334633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.335267:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841446528 00000100:00100000:0.0:1787430791.335278:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841446528 00000100:00100000:0.0:1787430791.335358:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:0.0:1787430791.335368:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10438:x1874256841446528:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787430791.335599:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10438:x1874256841446528:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 232us (973us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787430791.335607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:3.0:1787430791.339430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430791.343128:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841446784 00000100:00100000:2.0:1787430791.343143:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841446784 00000100:00100000:2.0:1787430791.343228:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:2.0:1787430791.343239:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10438:x1874256841446784:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787430791.343388:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10438:x1874256841446784:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 150us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430791.343396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:0.0:1787430791.354126:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.354194:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841446912 00000100:00100000:0.0:1787430791.354204:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841446912 00000100:00100000:0.0:1787430791.354268:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:0.0:1787430791.354278:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10438:x1874256841446912:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430791.354297:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430791.354318:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1464f expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.354428:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e6930b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.354442:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e6930b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.354453:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e6930b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430791.354491:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430791.354510:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e6930b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.354537:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e69304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1464f expref: 18 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.354556:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e6930b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1464f expref: 17 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.354564:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430791.354567:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787430791.354571:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262200, rc 0) 00000100:00100000:0.0:1787430791.354624:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10438:x1874256841446912:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 347us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430791.354638:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:0.0:1787430791.364821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.364900:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447040 00000100:00100000:1.0:1787430791.364910:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447040 00000100:00100000:1.0:1787430791.364965:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:1.0:1787430791.364985:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841447040:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430791.365016:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430791.365038:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14656 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430791.365064:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0786, blocks: 0x1 00010000:00010000:1.0:1787430791.365081:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=254s v=(0 0) 00010000:00010000:1.0:1787430791.365085:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430791.365095:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.365115:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.365128:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4c00, rc 0) 00000100:00100000:1.0:1787430791.365205:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841447040:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 221us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430791.365212:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:0.0:1787430791.369552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.370183:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447296 00000100:00100000:3.0:1787430791.370192:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447296 00000100:00100000:3.0:1787430791.370257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:3.0:1787430791.370269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10438:x1874256841447296:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787430791.370390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10438:x1874256841447296:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 123us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.370396:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:0.0:1787430791.392224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.392295:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447424 00000100:00100000:3.0:1787430791.392305:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447424 00000100:00100000:3.0:1787430791.392378:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:3.0:1787430791.392389:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:10438:x1874256841447424:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430791.392406:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430791.392426:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1465d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.392454:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.392464:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430791.392478:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430791.392484:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.392519:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.392534:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.392549:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fde300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856143616:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430791.392629:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430791.402306:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fde300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856143616:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430791.402373:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.402394:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b800, rc 0) 00000100:00100000:3.0:1787430791.402459:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:10438:x1874256841447424:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 10071us (10243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.402468:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:0.0:1787430791.405805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.406360:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447552 00000100:00100000:3.0:1787430791.406370:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447552 00010000:00010000:3.0:1787430791.406411:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.406445:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787430791.406468:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841447552:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430791.406485:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430791.406509:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.406523:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.406547:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69312 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14656 expref: 7 pid: 6683 timeout: 354 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.406563:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430791.406568:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430791.406576:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.406586:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.406621:0:11667:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.406636:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11667:1874256856143744:192.168.204.60@tcp:105: 00000100:00100000:3.0:1787430791.407014:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430791.420567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.420608:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447680 00000100:00100000:0.0:1787430791.420617:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447680 00002000:00100000:0.0:1787430791.420664:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0f2feada680 x1874256841447680/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:12/0 lens 504/0 e 0 to 0 dl 1787430802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430791.420686:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2feada680 with x1874256841447680 ext(0->8) 00002000:00010000:0.0:1787430791.420691:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2feada680 00000100:00100000:0.0:1787430791.420718:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:0.0:1787430791.420727:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841447680:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787430791.423112:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841447680:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 Request processed in 2379us (2548us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787430791.423125:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00002000:00100000:0.0:1787430791.423137:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0f2feada680 x1874256841447680/t4294967302(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:12/0 lens 504/448 e 0 to 0 dl 1787430802 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430791.423147:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2feada680 with x1874256841447680 ext(0->8) 00002000:00010000:0.0:1787430791.423165:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2feada680 00000100:00100000:3.0:1787430791.425100:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11667:1874256856143744:192.168.204.60@tcp:105: 00010000:00010000:3.0:1787430791.425142:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430791.425216:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841447552:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 18750us (19418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.425227:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787430791.438545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.438785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447808 00000100:00100000:1.0:1787430791.438795:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447808 00000100:00100000:1.0:1787430791.438863:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:1.0:1787430791.438874:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10438:x1874256841447808:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787430791.542077:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787430791.542095:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787430791.542113:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787430791.542139:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787430791.542264:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787430791.542452:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841447808:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 Request processed in 103573us (103911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430791.542463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787430791.548304:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856143872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787430791.548402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430791.548908:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856143872 00000100:00100000:1.0:1787430791.548924:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856143872 00000100:00100000:1.0:1787430791.548993:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430791.549002:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856143872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787430791.550293:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787430791.550300:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787430791 00002000:00010000:1.0:1787430791.550302:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787430791.550305:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787430790 -> 1787430791 00002000:00010000:1.0:1787430791.550307:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787430791.550384:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856143872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1381us (1981us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787430791.550393:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787430791.550421:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787430791.550729:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2f7fdce00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787430791.550737:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856143872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787430791.550915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.550940:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841447936 00000100:00100000:3.0:1787430791.550946:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841447936 00000100:00100000:3.0:1787430791.550989:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:3.0:1787430791.550998:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841447936:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1787430791.592987:0:12006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430791.592997:0:12006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430791.593044:0:12006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787430791.593050:0:12006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787430791.677413:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787430791.677434:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1787430791.680616:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841447936:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 Request processed in 129608us (129693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.680630:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:0.0:1787430791.697527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.697569:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841448192 00000100:00100000:0.0:1787430791.697578:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841448192 00000100:00100000:0.0:1787430791.697633:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:0.0:1787430791.697644:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841448192:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430791.697706:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430791.697750:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e6930b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1464f expref: 13 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.697772:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430791.697777:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430791.697811:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.697824:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.697845:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430791.698101:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bec3a2d7 reply state 0000000096c75346 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430791.698111:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430791.698216:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10438:x1874256841448192:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 573us (698us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787430791.698223:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:0.0:1787430791.724770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.726106:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841448320 00000100:00100000:0.0:1787430791.726117:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841448320 00000100:00100000:0.0:1787430791.726202:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:0.0:1787430791.726213:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841448320:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787430791.726482:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787430791.726486:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787430791 -> 1787430789 00002000:00010000:0.0:1787430791.726489:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787430786 00002000:00010000:0.0:1787430791.726492:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787430791 -> 1787430789 00002000:00010000:0.0:1787430791.726494:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787430791.726553:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841448320:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 342us (1791us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787430791.726561:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:3.0:1787430791.729476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:1.0:1787430791.730618:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.730632:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.730641:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.730647:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430791.730651:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.730659:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.730945:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430791.730949:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430791.730954:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.730960:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69320 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430791.731660:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841448576 00000100:00100000:2.0:1787430791.731671:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841448576 00000100:00100000:2.0:1787430791.731730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:2.0:1787430791.731742:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10438:x1874256841448576:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787430791.731814:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.731828:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 13 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.731836:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.731871:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 13 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.731886:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 13 pid: 9043 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430791.731900:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856144000:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430791.732117:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7fc60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430791.739518:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430791.739636:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856144000:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430791.739666:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430791.739767:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841448704 00000100:00100000:1.0:1787430791.739774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841448704 00010000:00010000:1.0:1787430791.739811:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 14 pid: 9043 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430791.739861:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:1.0:1787430791.739870:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:2373:x1874256841448704:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430791.739885:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430791.739892:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 14 pid: 9043 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.739903:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 14 pid: 9043 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.739925:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e692e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14641 expref: 14 pid: 9043 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.739940:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:1.0:1787430791.739945:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.739974:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.739981:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.740009:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430791.740058:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841448704:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 188us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430791.740065:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 43 00010000:00010000:0.0:1787430791.740254:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740261:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740294:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740300:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740305:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740318:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430791.740322:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740357:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740366:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430791.740368:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787430791.740372:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.740377:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69327 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430791.740428:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841448576:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 Request processed in 8688us (10959us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787430791.740435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:2.0:1787430791.755234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.755890:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841448832 00000100:00100000:3.0:1787430791.755900:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841448832 00000100:00100000:3.0:1787430791.755971:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:3.0:1787430791.755983:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841448832:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787430791.756028:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.756057:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.756066:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787430791.756070:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430791.756075:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.756107:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.756120:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 7 pid: 6685 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.756133:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856144128:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430791.756227:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430791.759410:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856144128:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430791.759462:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430791.768011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.768102:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841448960 00000100:00100000:3.0:1787430791.768112:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841448960 00010000:00010000:3.0:1787430791.768150:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 8 pid: 6685 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.768203:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:3.0:1787430791.768215:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841448960:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430791.768229:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430791.768252:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 8 pid: 6685 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768273:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 8 pid: 6685 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768298:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000216d78a6/0x1fa5b1e070e69319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1465d expref: 8 pid: 6685 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768314:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430791.768318:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430791.768346:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768357:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768385:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430791.768436:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841448960:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 222us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.768443:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 44 00010000:00010000:3.0:1787430791.768558:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768568:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768591:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768605:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768613:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768619:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430791.768624:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768633:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768644:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.768651:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e6932e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.768719:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841448832:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 Request processed in 12738us (13494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.768737:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:2.0:1787430791.772421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.772501:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841449216 00000100:00100000:1.0:1787430791.772511:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841449216 00000100:00100000:1.0:1787430791.772571:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:1.0:1787430791.772581:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:10438:x1874256841449216:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787430791.772662:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.773602:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.773613:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.774112:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.774125:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.774143:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.774304:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.774319:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 13 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430791.774363:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856144256:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430791.774461:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2b73f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430791.791177:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9394000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856144256:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430791.791206:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430791.792167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430791.792240:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841449344 00000100:00100000:3.0:1787430791.792249:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841449344 00010000:00010000:3.0:1787430791.792284:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 14 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.792349:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:3.0:1787430791.792359:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:2373:x1874256841449344:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430791.792373:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430791.792380:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 14 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.792393:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 14 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.792414:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e692f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14648 expref: 14 pid: 5837 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.792431:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:3.0:1787430791.792437:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.792456:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.792464:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.792491:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430791.792546:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841449344:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 188us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.792554:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 45 00010000:00010000:1.0:1787430791.793132:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.793141:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430791.793354:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787430791.794641:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787430791.794706:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787430791.794798:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874256856144384:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787430791.794864:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430791.794903:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430791.794924:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856144384 00000100:00100000:0.0:1787430791.794931:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856144384 00000100:00100000:0.0:1787430791.794988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430791.794998:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874256856144384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787430791.795083:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874256856144384:12345-0@lo:1000:mdt00_000.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430791.795091:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430791.795433:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787430791.795439:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2f7fdce00, transno 4294967303 00000100:00100000:1.0:1787430791.795607:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874256856144384:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787430791.798550:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787430791.798646:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fead8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874256856144512:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787430791.798712:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430791.798755:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430791.800514:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856144512 00000100:00100000:1.0:1787430791.800533:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856144512 00000100:00100000:1.0:1787430791.800597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430791.800607:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874256856144512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787430791.800853:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874256856144512:12345-0@lo:1000:mdt00_000.0 Request processed in 247us (2139us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787430791.800861:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430791.800933:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fead8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874256856144512:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787430791.800989:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.800999:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801006:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801012:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430791.801017:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801025:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801039:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d22f0000) 00010000:00010000:0.0:1787430791.801043:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430791.801047:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801053:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6933c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801094:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801101:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801107:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801119:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430791.801122:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801128:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801136:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:0.0:1787430791.801138:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430791.801141:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801160:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6926a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801195:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801210:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801219:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801250:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430791.801264:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 16 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430791.801291:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feadb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856144640:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430791.801386:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430791.818219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.818375:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841449472 00000100:00100000:1.0:1787430791.818383:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841449472 00000100:00100000:3.0:1787430791.818397:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feadb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856144640:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430791.818417:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 17 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818420:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430791.818449:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:3.0:1787430791.818460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:2374:x1874256841449472:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430791.818473:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430791.818480:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 17 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818493:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 17 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818513:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1462c expref: 17 pid: 5839 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818531:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:3.0:1787430791.818535:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818545:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818552:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430791.818598:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430791.818647:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:2374:x1874256841449472:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 189us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430791.818654:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00010000:00010000:1.0:1787430791.819137:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819146:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819158:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819164:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819171:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819177:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430791.819181:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819188:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819208:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:1.0:1787430791.819211:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430791.819214:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819219:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69343 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819234:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819240:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819245:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819249:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430791.819252:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819257:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819263:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0800) 00010000:00010000:1.0:1787430791.819265:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787430791.819268:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.819272:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69335 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430791.819537:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10438:x1874256841449216:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 46954us (47122us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787430791.819547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 82 00000020:00080000:1.0:1787430791.819551:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787430791.820073:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430791.820078:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430791.820104:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787430791.820109:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430791.827503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430791.827588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841449728 00000100:00100000:1.0:1787430791.827597:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841449728 00000100:00100000:1.0:1787430791.827649:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:1.0:1787430791.827660:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10438:x1874256841449728:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787430791.828413:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787430791.828514:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787430791.828560:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.828575:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.828585:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.828593:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.828600:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.828606:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430791.828622:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787430791.828719:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10438:x1874256841449728:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 1059us (1223us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787430791.828728:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000020:00080000:1.0:1787430791.828733:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787430791.829278:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430791.829286:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.829295:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430791.829299:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.829306:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.829318:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0f2d0ce5a00) 00010000:00010000:2.0:1787430791.829321:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787430791.829352:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.829359:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e6934a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430791.829379:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430791.829381:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430791.829400:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430792.222500:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430792.412748:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787430792.412770:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856144768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430792.412840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430792.412907:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856144768 00000100:00100000:2.0:1787430792.412924:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856144768 00000100:00100000:2.0:1787430792.412984:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430792.412992:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856144768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430792.413203:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430792.413246:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856144768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430792.413254:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787430792.413273:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430792.413306:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856144768:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787430792.502317:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1787430792.502362:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1787430793.246212:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430793.439076:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856145152:0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.439155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430793.439207:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430793.439214:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856145280:0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.439242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430793.439278:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856145152 00000100:00100000:3.0:1787430793.439284:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856145152 00000100:00100000:3.0:1787430793.439354:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787430793.439364:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856145152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.439413:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856145152:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430793.439421:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787430793.439442:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856145280 00000100:00100000:3.0:1787430793.439446:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856145280 00000100:00100000:3.0:1787430793.439472:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787430793.439478:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856145280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.439522:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856145280:12345-0@lo:400:kworker.0 Request processed in 44us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430793.439529:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787430793.439547:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430793.439575:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787430793.439580:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787430793.439597:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2f7fdf800, transno 4294967301 00000100:00100000:3.0:1787430793.439611:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856145280:0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.439624:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856145152:0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.440248:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856144896:0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.440288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430793.440351:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856145408:0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.440378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430793.440397:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787430793.440402:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856145024:0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.440424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430793.440447:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2f7fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856145536:0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.440470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430793.440498:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856145536 00000100:00100000:1.0:1787430793.440503:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856145536 00000100:00100000:1.0:1787430793.440537:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787430793.440545:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856145536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.440585:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856145536:12345-0@lo:400:kworker.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430793.440591:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787430793.440621:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856145536:0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.441472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856144896 00000100:00100000:3.0:1787430793.441479:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856144896 00000100:00100000:3.0:1787430793.441524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787430793.441532:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856144896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430793.441588:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856144896:12345-0@lo:400:kworker.0 Request processed in 57us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430793.441595:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787430793.441638:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856144896:0@lo:400:kworker.0 00000100:00080000:3.0:1787430793.441897:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430793.442444:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856145408 00000100:00100000:2.0:1787430793.442450:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856145408 00000100:00100000:2.0:1787430793.442537:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856145024 00000100:00100000:2.0:1787430793.442541:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856145024 00000100:00100000:2.0:1787430793.442565:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787430793.442574:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856145408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430793.442628:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856145408:12345-0@lo:400:kworker.0 Request processed in 56us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430793.442636:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787430793.443834:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787430793.443847:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856145024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430793.443903:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856145024:12345-0@lo:400:kworker.0 Request processed in 59us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430793.443924:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787430793.444003:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856145664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430793.444042:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430793.444078:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856145664 00000100:00100000:2.0:1787430793.444083:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856145664 00000100:00100000:2.0:1787430793.444123:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430793.444130:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856145664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430793.444157:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430793.444193:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856145664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430793.444199:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430793.444237:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856145664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430793.446446:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856145024:0@lo:400:kworker.0 00000100:00100000:1.0:1787430793.446465:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2f7fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856145408:0@lo:400:kworker.0 00000100:00080000:3.0:1787430793.447212:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787430793.900722:0:12059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430793.900732:0:12059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430793.900789:0:12059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787430793.900796:0:12059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430794.189029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430794.189411:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841449984 00000100:00100000:3.0:1787430794.189420:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841449984 00000100:00100000:3.0:1787430794.189492:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:3.0:1787430794.189503:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10456:x1874256841449984:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430794.189526:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430794.189547:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14664 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.189818:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69358 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.189833:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.189847:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430794.189859:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787430794.190900:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14664 expref: 20 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.190935:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14664 expref: 19 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.190943:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430794.190947:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430794.190950:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b800, rc 0) 00000100:00100000:3.0:1787430794.191070:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10456:x1874256841449984:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1568us (2062us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787430794.191078:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00080000:0.0:1787430794.191215:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430794.214349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.218308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841450112 00000100:00100000:1.0:1787430794.218323:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841450112 00000100:00100000:1.0:1787430794.218491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:1.0:1787430794.218502:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10456:x1874256841450112:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:1.0:1787430794.218578:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.218595:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.218607:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.218622:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.218629:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.218637:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220202:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220216:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220225:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430794.220281:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220295:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220302:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220309:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220315:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.220320:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220341:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220353:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430794.220356:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.220360:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220366:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220379:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220385:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220398:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220403:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.220406:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220413:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220420:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d0ce5000) 00010000:00010000:1.0:1787430794.220423:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.220426:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220432:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6936d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220448:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220455:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220461:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220466:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.220469:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220484:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220493:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430794.220495:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.220498:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.220504:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430794.220595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10456:x1874256841450112:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 2090us (6265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430794.220604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 84 00010000:00010000:2.0:1787430794.270627:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430794.287079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430794.287257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841450368 00000100:00100000:2.0:1787430794.287269:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841450368 00000100:00100000:2.0:1787430794.287369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787430794.287381:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10459:x1874256841450368:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430794.287401:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430794.287422:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6937b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1466b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287499:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287513:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287539:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287554:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287561:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287568:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287885:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287895:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.287902:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430794.287911:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787430794.288019:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288026:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288032:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288037:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430794.288048:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288070:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288083:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430794.288086:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430794.288091:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288098:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288111:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288118:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288124:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288130:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430794.288133:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288139:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288146:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430794.288149:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430794.288157:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288164:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288208:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6937b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288224:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.288231:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:2.0:1787430794.288234:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430794.288236:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74e00, rc 0) 00000100:00100000:2.0:1787430794.288295:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:10459:x1874256841450368:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 917us (1227us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787430794.288303:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:0.0:1787430794.302254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430794.302507:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841450496 00000100:00100000:3.0:1787430794.302518:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841450496 00000100:00100000:3.0:1787430794.302994:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787430794.303007:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:10459:x1874256841450496:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:3.0:1787430794.303124:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303140:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303150:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303179:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303186:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303193:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303199:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430794.303203:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303210:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303222:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:3.0:1787430794.303225:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430794.303230:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.303236:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6939e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430794.303378:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:10459:x1874256841450496:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 373us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430794.303386:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787430794.308788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.308937:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841450752 00000100:00100000:1.0:1787430794.308947:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841450752 00000100:00100000:1.0:1787430794.310664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:1.0:1787430794.310684:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:10459:x1874256841450752:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:1.0:1787430794.310943:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:10459:x1874256841450752:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 267us (2164us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787430794.310951:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:2.0:1787430794.394841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.395538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451008 00000100:00100000:1.0:1787430794.395549:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451008 00000100:00100000:1.0:1787430794.395613:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:1.0:1787430794.395624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:9980:x1874256841451008:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430794.395999:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430794.396576:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14672 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.397259:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.397277:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.397285:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.397322:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.397362:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 23 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430794.397376:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856145792:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430794.399801:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787430794.407149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.407371:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856145792:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430794.407400:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430794.408075:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451136 00000100:00100000:2.0:1787430794.408084:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451136 00010000:00010000:2.0:1787430794.408132:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 24 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430794.408168:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:2.0:1787430794.408178:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:2374:x1874256841451136:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430794.408193:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430794.408201:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 24 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.408224:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 24 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.408246:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1466b expref: 24 pid: 5838 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.408263:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:2.0:1787430794.408268:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.408277:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.408284:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.408312:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430794.408395:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:2374:x1874256841451136:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 218us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430794.408404:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00010000:00010000:1.0:1787430794.409391:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.409402:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430794.409436:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787430794.409582:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.409618:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.409627:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:1.0:1787430794.409630:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430794.409633:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4a00, rc 0) 00000100:00100000:1.0:1787430794.409689:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:9980:x1874256841451008:12345-192.168.204.60@tcp:101:bash.0 Request processed in 14067us (14858us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787430794.409699:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:0.0:1787430794.419998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.420792:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451392 00000100:00100000:1.0:1787430794.420802:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451392 00000100:00100000:1.0:1787430794.420859:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:1.0:1787430794.420870:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:9980:x1874256841451392:12345-192.168.204.60@tcp:36:bash.0 00010000:00010000:1.0:1787430794.421174:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.421191:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.421203:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430794.421256:0:6884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787430794.421295:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2e1a3e4 reply state 0000000038062cdb transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430794.421304:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787430794.421389:0:6884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787430794.424637:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:9980:x1874256841451392:12345-192.168.204.60@tcp:36:bash.0 Request processed in 3749us (4629us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787430794.424650:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 88 00000020:00080000:1.0:1787430794.424660:0:6884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787430794.427321:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.427521:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.427529:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.427535:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430794.427541:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.427549:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.427566:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:0.0:1787430794.427569:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430794.427574:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.427599:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430794.437219:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430794.442712:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451520 00000100:00100000:3.0:1787430794.442728:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451520 00000100:00100000:2.0:1787430794.444427:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:2.0:1787430794.445169:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:9980:x1874256841451520:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430794.445197:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430794.445220:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e693c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14679 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.445281:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e693c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14679 expref: 27 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.445312:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e693c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14679 expref: 27 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.447193:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:2.0:1787430794.447201:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430794.447206:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75400, rc 0) 00000100:00100000:2.0:1787430794.447290:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:9980:x1874256841451520:12345-192.168.204.60@tcp:101:bash.0 Request processed in 2126us (10077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430794.447300:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:2.0:1787430794.456998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430794.457544:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451648 00000100:00100000:3.0:1787430794.457553:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451648 00000100:00100000:3.0:1787430794.457646:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:3.0:1787430794.457658:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:9980:x1874256841451648:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787430794.457676:0:8633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430794.457696:0:8633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14680 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430794.457724:0:8633:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0785, atime: 0x6a8a0782, ctime: 0x6a8a0785, blocks: 0xb 00010000:00010000:3.0:1787430794.457744:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=258s v=(0 0) 00010000:00010000:3.0:1787430794.457749:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430794.457757:0:8633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.457775:0:8633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430794.457798:0:8633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00080000:1.0:1787430794.458061:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430794.463222:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:9980:x1874256841451648:12345-192.168.204.60@tcp:101:bash.0 Request processed in 5556us (6222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430794.463255:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:3.0:1787430794.478213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430794.478768:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451776 00000100:00100000:2.0:1787430794.478921:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451776 00002000:00010000:2.0:1787430794.478967:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787430794.478972:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2f7fdc700 with x1874256841451776 ext(0->18446744073709551615) 00002000:00010000:2.0:1787430794.478984:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2f7fdc700. 00000100:00100000:2.0:1787430794.479129:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:2.0:1787430794.479142:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841451776:12345-192.168.204.60@tcp:10:bash.0 00002000:00010000:2.0:1787430794.479445:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787430794.479449:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787430789 -> 1787430794 00002000:00010000:2.0:1787430794.479451:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787430786 -> 1787430786 00002000:00010000:2.0:1787430794.479453:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787430789 -> 1787430794 00002000:00010000:2.0:1787430794.479456:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787430794.483494:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841451776:12345-192.168.204.60@tcp:10:bash.0 Request processed in 4343us (5280us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787430794.483509:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00002000:00010000:2.0:1787430794.483535:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787430794.483538:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2f7fdc700 with x1874256841451776 ext(0->18446744073709551615) 00002000:00010000:2.0:1787430794.483550:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2f7fdc700. 00000100:00100000:0.0:1787430794.662231:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.662884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841451904 00000100:00100000:1.0:1787430794.662895:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841451904 00000100:00100000:1.0:1787430794.662973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:1.0:1787430794.662982:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:10473:x1874256841451904:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:1.0:1787430794.663065:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.663083:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.663105:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.663122:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.663128:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.663135:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666149:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666168:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666178:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430794.666224:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666236:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666243:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666250:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666256:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.666260:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666268:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666279:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430794.666282:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.666286:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666300:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e693cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666313:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666319:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666515:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666522:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.666526:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666532:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666541:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430794.666543:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.666546:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666552:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e693d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666568:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666574:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666585:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666590:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.666593:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666599:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666606:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:1.0:1787430794.666609:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.666612:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.666617:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e693dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430794.667173:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:10473:x1874256841451904:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 4187us (4946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430794.667184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:2.0:1787430794.746135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.746677:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841452160 00000100:00100000:1.0:1787430794.746687:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841452160 00000100:00100000:0.0:1787430794.747315:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:0.0:1787430794.747342:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:10476:x1874256841452160:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430794.747361:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430794.747381:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e693e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14687 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747467:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747481:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747492:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747506:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747513:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747520:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747835:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e693f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747851:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e693f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747858:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e693f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430794.747869:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787430794.747977:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747985:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747991:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.747997:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430794.748001:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749406:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749483:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430794.749487:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430794.749492:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749500:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e693eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749520:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749536:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749542:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749548:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430794.749551:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749557:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749565:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430794.749568:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430794.749570:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749576:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e693f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749630:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e693e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14687 expref: 30 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749646:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e693f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14687 expref: 29 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.749654:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:0.0:1787430794.749656:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787430794.749666:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262600, rc 0) 00000100:00100000:0.0:1787430794.750142:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10476:x1874256841452160:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 2814us (4011us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787430794.750151:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:3.0:1787430794.753392:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430794.754069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841452288 00000100:00100000:0.0:1787430794.754079:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841452288 00000100:00100000:0.0:1787430794.754190:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:0.0:1787430794.754201:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10476:x1874256841452288:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:0.0:1787430794.754272:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.754288:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.754299:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.754383:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.754397:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 29 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430794.754411:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856145920:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430794.754503:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430794.759242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430794.759313:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856145920:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430794.759469:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430794.759735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841452544 00000100:00100000:3.0:1787430794.759742:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841452544 00000100:00100000:3.0:1787430794.759807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787430794.759817:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:5605:x1874256841452544:12345-192.168.204.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787430794.760313:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:5605:x1874256841452544:12345-192.168.204.60@tcp:35:ldlm_bl.0 Request processed in 495us (1078us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787430794.760321:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787430794.763628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430794.767296:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841452672 00000100:00100000:0.0:1787430794.767310:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841452672 00010000:00010000:0.0:1787430794.767404:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 31 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430794.767438:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:0.0:1787430794.767448:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:2374:x1874256841452672:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430794.767464:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430794.767472:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 31 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.767486:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 31 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.767508:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e693ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14672 expref: 31 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.767528:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:0.0:1787430794.767534:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.767544:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.767553:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.767591:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430794.767636:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.767648:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430794.767676:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:2374:x1874256841452672:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 228us (4054us total) trans 0 rc 0/0 00010000:00010000:2.0:1787430794.767679:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430794.767688:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00010000:00010000:2.0:1787430794.767691:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.767700:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.767706:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430794.767711:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.767718:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.767727:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:2.0:1787430794.767730:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430794.767733:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430794.767739:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e69407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430794.767802:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10476:x1874256841452288:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 13602us (14418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430794.767810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:2.0:1787430794.774125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.774397:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841452928 00000100:00100000:1.0:1787430794.774408:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841452928 00000100:00100000:1.0:1787430794.774953:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:1.0:1787430794.774965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:10476:x1874256841452928:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:1.0:1787430794.775238:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:10476:x1874256841452928:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 275us (1123us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787430794.775259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:3.0:1787430794.916682:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430794.916796:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841453184 00000100:00100000:1.0:1787430794.916807:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841453184 00000100:00100000:1.0:1787430794.916869:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:1.0:1787430794.916878:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:10488:x1874256841453184:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:1.0:1787430794.916914:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430794.916935:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6940e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1468e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917059:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917076:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917097:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917113:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917120:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917127:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917490:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917512:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917519:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430794.917529:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787430794.917625:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917632:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917639:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917645:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.917650:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917658:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917671:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430794.917674:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.917678:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917684:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917697:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917709:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917715:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917720:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430794.917722:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917728:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917736:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d0ce5200) 00010000:00010000:1.0:1787430794.917738:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430794.917741:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917747:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6941c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917792:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6940e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1468e expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917808:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1468e expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.917815:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:1.0:1787430794.917817:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430794.917826:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4c00, rc 0) 00000100:00100000:1.0:1787430794.917914:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10488:x1874256841453184:12345-192.168.204.60@tcp:101:cat.0 Request processed in 1024us (1229us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787430794.917922:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:2.0:1787430794.928641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430794.928734:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841453440 00000100:00100000:3.0:1787430794.928743:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841453440 00000100:00100000:3.0:1787430794.928803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:3.0:1787430794.928814:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10488:x1874256841453440:12345-192.168.204.60@tcp:35:cat.0 00000100:00100000:3.0:1787430794.929088:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:10488:x1874256841453440:12345-192.168.204.60@tcp:35:cat.0 Request processed in 274us (455us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787430794.929096:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:3.0:1787430794.997223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430794.997662:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841453696 00000100:00100000:0.0:1787430794.997673:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841453696 00000100:00100000:0.0:1787430794.997742:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 94 00000100:00100000:0.0:1787430794.997754:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:10489:x1874256841453696:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787430794.997841:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787430794.997869:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1468e expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.997895:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e693f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14687 expref: 32 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.997923:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e693c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14679 expref: 31 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.997936:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d22f0b00) 00010000:00010000:0.0:1787430794.997947:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430794.997969:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.997982:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.997992:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.998019:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.998040:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.998048:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.998406:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.998415:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.998423:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430794.999048:0:6884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787430794.999057:0:6884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 258553729770ns, next at 259553727398ns, rc = 0 00010000:00010000:0.0:1787430794.999115:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999124:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999132:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999138:0:6884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999144:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999161:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999189:0:6884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430794.999214:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999221:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999227:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999233:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430794.999238:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999245:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999256:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d2bc4f00) 00010000:00010000:0.0:1787430794.999258:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787430794.999262:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999269:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6943f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999284:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999289:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999300:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999305:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430794.999308:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999314:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999323:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430794.999350:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430794.999354:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430794.999360:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69431 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430794.999372:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b282c0c2 reply state 00000000c65e7619 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430794.999380:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430794.999469:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:10489:x1874256841453696:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1715us (2262us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787430794.999477:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 94 00010000:00010000:1.0:1787430794.999630:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430794.999637:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.999643:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430794.999646:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.999652:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.999662:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0f2d2bc4f00) 00010000:00010000:1.0:1787430794.999664:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787430794.999667:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.999674:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69446 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430794.999688:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430794.999690:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430794.999692:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430795.002731:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.002749:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.002888:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.002895:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430795.002908:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.002917:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.002933:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d2bc4800) 00010000:00010000:1.0:1787430795.002936:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430795.002940:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.002947:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69438 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430795.075131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.075362:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841453952 00000100:00100000:2.0:1787430795.075372:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841453952 00000100:00100000:2.0:1787430795.075436:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:2.0:1787430795.075446:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:10495:x1874256841453952:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430795.075470:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.075489:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6944d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14695 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.075617:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.075633:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.075644:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.075658:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.075666:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.075673:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430795.076221:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787430795.076392:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076401:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076410:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076446:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076453:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076459:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076465:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.076469:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076477:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076488:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430795.076492:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.076495:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076511:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69454 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430795.076524:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000389278f1 reply state 0000000033fc4b45 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430795.076532:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787430795.076561:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6944d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076575:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.076582:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:2.0:1787430795.076585:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430795.076587:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74400, rc 0) 00000100:00100000:2.0:1787430795.076657:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:10495:x1874256841453952:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1213us (1538us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787430795.076666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:3.0:1787430795.079537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:2.0:1787430795.079956:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.079969:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.079977:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.079984:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.080008:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.080017:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.080032:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430795.080035:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.080039:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.080046:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e6945b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.080167:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841454080 00000100:00100000:1.0:1787430795.080176:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841454080 00000100:00100000:1.0:1787430795.080244:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:1.0:1787430795.080253:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841454080:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430795.080267:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430795.080284:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1469c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430795.080307:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430795.080322:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=258s v=(0 0) 00010000:00010000:1.0:1787430795.080354:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430795.080363:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.080381:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.080392:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4400, rc 0) 00000100:00100000:1.0:1787430795.080441:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841454080:12345-192.168.204.60@tcp:101:bash.0 Request processed in 189us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430795.080448:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00080000:2.0:1787430795.080515:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430795.089018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.089311:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841454208 00000100:00100000:2.0:1787430795.089321:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841454208 00000100:00100000:2.0:1787430795.089390:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:2.0:1787430795.089399:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:10495:x1874256841454208:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430795.089417:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.089436:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146a3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.089466:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.089476:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430795.089481:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430795.089486:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.089532:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.089546:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430795.089561:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1874256856146048:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430795.089667:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7fc66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430795.093419:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1874256856146048:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430795.093455:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.093475:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430795.093544:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:10495:x1874256841454208:12345-192.168.204.60@tcp:101:bash.0 Request processed in 4145us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.093554:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:3.0:1787430795.094181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430795.098162:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841454336 00000100:00100000:1.0:1787430795.098174:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841454336 00010000:00010000:1.0:1787430795.098220:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.098323:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:1.0:1787430795.098333:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841454336:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430795.098347:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430795.098370:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.098399:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.098421:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69470 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1469c expref: 7 pid: 6683 timeout: 358 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.098452:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430795.098457:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430795.098465:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.098476:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.098515:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.098529:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874256856146176:192.168.204.60@tcp:105: 00000100:00100000:1.0:1787430795.098622:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430795.109689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.109773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841454592 00000100:00100000:0.0:1787430795.109783:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841454592 00000100:00100000:0.0:1787430795.109855:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:0.0:1787430795.109866:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:10495:x1874256841454592:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:0.0:1787430795.110237:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:10495:x1874256841454592:12345-192.168.204.60@tcp:35:bash.0 Request processed in 371us (555us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787430795.110245:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:1.0:1787430795.116404:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874256856146176:192.168.204.60@tcp:105: 00010000:00010000:1.0:1787430795.116431:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430795.119946:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841454336:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 21601us (25753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.119960:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 49 00010000:00010000:0.0:1787430795.292571:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430795.300887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.301315:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841454720 00000100:00100000:2.0:1787430795.301351:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841454720 00000100:00100000:2.0:1787430795.301410:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 96 00000100:00100000:2.0:1787430795.301422:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:10511:x1874256841454720:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430795.301446:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.301468:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6947e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146aa expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.301556:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.301570:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.301581:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430795.301639:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787430795.301644:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430795.301665:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.301690:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6947e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146aa expref: 36 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.301706:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146aa expref: 35 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.301715:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430795.301717:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430795.301721:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75800, rc 0) 00000100:00100000:2.0:1787430795.301799:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10511:x1874256841454720:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 380us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.301805:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 96 00000100:00100000:3.0:1787430795.306246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.306370:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841454976 00000100:00100000:2.0:1787430795.306379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841454976 00000100:00100000:2.0:1787430795.306447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:2.0:1787430795.306458:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:10511:x1874256841454976:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430795.306479:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.306499:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6948c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146b1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.306605:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.306620:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.306630:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430795.306641:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787430795.306786:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6948c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b1 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.306804:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b1 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.306813:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:2.0:1787430795.306816:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430795.306820:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75400, rc 0) 00000100:00100000:2.0:1787430795.306882:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:10511:x1874256841454976:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 425us (645us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787430795.306888:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:3.0:1787430795.316780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430795.318140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.318381:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841455360 00000100:00100000:0.0:1787430795.318393:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841455360 00000100:00100000:0.0:1787430795.318461:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:0.0:1787430795.318472:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:2372:x1874256841455360:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430795.318487:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430795.318510:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b1 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.318527:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:0.0:1787430795.318532:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430795.318585:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:2372:x1874256841455360:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 115us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.318593:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:1.0:1787430795.319381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841455232 00000100:00100000:1.0:1787430795.319388:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841455232 00000100:00100000:1.0:1787430795.319486:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 98 00000100:00100000:1.0:1787430795.319495:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:10511:x1874256841455232:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430795.319516:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430795.319533:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e694a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146b8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.319633:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e694a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.319658:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e694a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.319669:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e694a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430795.319683:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787430795.319806:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e694a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b8 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.319848:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e694a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b8 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.319857:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:1.0:1787430795.319860:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787430795.319863:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5200, rc 0) 00000100:00100000:1.0:1787430795.319991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:10511:x1874256841455232:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 497us (3230us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787430795.320114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 98 00000100:00100000:3.0:1787430795.326882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430795.326973:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841455488 00000100:00100000:1.0:1787430795.326982:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841455488 00000100:00100000:1.0:1787430795.327036:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:1.0:1787430795.327047:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841455488:12345-192.168.204.60@tcp:1:lfs.0 00010000:00010000:1.0:1787430795.327109:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.327130:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.327154:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430795.327158:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430795.327163:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.327199:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.327212:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 6 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.327227:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874256856146304:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430795.327345:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430795.332169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.332399:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841455616 00000100:00100000:0.0:1787430795.332408:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841455616 00002000:00100000:0.0:1787430795.332453:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0f2fee96300 x1874256841455616/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:16/0 lens 504/0 e 0 to 0 dl 1787430806 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430795.332465:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fee96300 with x1874256841455616 ext(0->8) 00010000:00010000:0.0:1787430795.332474:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 7 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.332502:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 7 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430795.332510:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fee96300 00000100:00100000:0.0:1787430795.332552:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:0.0:1787430795.332561:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841455616:12345-192.168.204.60@tcp:4:lfs.0 00000100:00100000:0.0:1787430795.333051:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2373:x1874256841455616:12345-192.168.204.60@tcp:4:lfs.0 Request processed in 489us (891us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787430795.333059:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00002000:00100000:0.0:1787430795.333065:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0f2fee96300 x1874256841455616/t4294967302(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:16/0 lens 504/448 e 0 to 0 dl 1787430806 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787430795.333382:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874256856146304:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430795.333405:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787430795.334251:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fee96300 with x1874256841455616 ext(0->8) 00010000:00010000:0.0:1787430795.334265:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 9 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.334280:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 9 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430795.334288:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fee96300 00000100:00100000:3.0:1787430795.336042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430795.336386:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841455744 00000100:00100000:1.0:1787430795.336394:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841455744 00010000:00010000:1.0:1787430795.336431:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 9 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.336518:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:1.0:1787430795.336527:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2371:x1874256841455744:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430795.336563:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787430795.336581:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787430795.336583:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787430794 00002000:00010000:1.0:1787430795.336586:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787430794 00002000:00010000:1.0:1787430795.336588:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787430794 00010000:00010000:1.0:1787430795.336594:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 9 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.336606:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 9 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.336628:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000086edc84/0x1fa5b1e070e69477 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146a3 expref: 9 pid: 6686 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.336645:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430795.336650:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430795.336655:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.336665:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.336700:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430795.336771:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2371:x1874256841455744:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 238us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430795.336779:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00010000:00010000:0.0:1787430795.337465:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337478:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337518:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337527:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337547:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337555:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430795.337559:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337568:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337584:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.337590:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c55559a/0x1fa5b1e070e694b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430795.337655:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841455488:12345-192.168.204.60@tcp:1:lfs.0 Request processed in 10609us (10780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.337663:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:3.0:1787430795.341240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.341529:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841456000 00000100:00100000:0.0:1787430795.341547:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841456000 00000100:00100000:0.0:1787430795.341598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:0.0:1787430795.341608:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:10511:x1874256841456000:12345-192.168.204.60@tcp:35:lfs.0 00000004:00010000:0.0:1787430795.341668:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e694a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b8 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430795.341930:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787430795.341971:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787430795.342531:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787430795.342600:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.342615:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.342624:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.342656:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.342670:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 42 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430795.342686:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874256856146432:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430795.343016:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430795.346405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430795.346491:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841456128 00000100:00100000:1.0:1787430795.346500:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841456128 00010000:00010000:1.0:1787430795.346544:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 43 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.346581:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:1.0:1787430795.346590:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:2374:x1874256841456128:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430795.346605:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430795.346611:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 43 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.346625:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 43 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.346646:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:1.0:1787430795.346651:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.346660:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.346667:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.346684:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430795.346739:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:2374:x1874256841456128:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430795.346747:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00010000:00010000:0.0:1787430795.348463:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14695 expref: 42 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430795.348504:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874256856146432:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430795.348525:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.348546:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.348553:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430795.348668:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787430795.349263:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787430795.349651:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856146560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787430795.349708:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.349913:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430795.350232:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856146560 00000100:00100000:3.0:1787430795.350239:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856146560 00000100:00100000:3.0:1787430795.350380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787430795.350391:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856146560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430795.350472:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856146560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430795.350480:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430795.350584:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856146560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787430795.351391:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787430795.351459:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856146688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787430795.351496:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430795.351525:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430795.351592:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856146688 00000100:00100000:1.0:1787430795.351604:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856146688 00000100:00100000:1.0:1787430795.351627:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430795.351634:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856146688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787430795.351809:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874256856146688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (312us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787430795.351816:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430795.352688:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856146688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787430795.352770:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787430795.352815:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.352826:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.352842:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.352848:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430795.352853:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.352860:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.352875:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:0.0:1787430795.352878:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787430795.352882:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.352888:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263a00/0x1fa5b1e070e694bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787430795.353239:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787430795.353323:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787430795.353585:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 258908257644ns, next at 259908255035ns, rc = 0 00000001:00080000:0.0:1787430795.353592:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787430795.353627:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d22f0700) 00010000:00010000:0.0:1787430795.353630:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787430795.353637:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e694a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146b8 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430795.353748:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:10511:x1874256841456000:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 12141us (12514us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787430795.353882:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000020:00080000:0.0:1787430795.353888:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787430795.356564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.356875:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841456256 00000100:00100000:0.0:1787430795.356884:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841456256 00000100:00100000:0.0:1787430795.356947:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:0.0:1787430795.356957:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:10511:x1874256841456256:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430795.356978:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430795.357009:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e694c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146bf expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.357190:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e694c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146bf expref: 46 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.357205:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e694c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146bf expref: 46 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.357226:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:0.0:1787430795.357230:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430795.357233:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262600, rc 0) 00000100:00100000:0.0:1787430795.357280:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+46:10511:x1874256841456256:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 324us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.357287:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00080000:2.0:1787430795.359442:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430795.361934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.362035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841456512 00000100:00100000:2.0:1787430795.362044:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841456512 00000100:00100000:2.0:1787430795.362101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:2.0:1787430795.362110:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+46:10511:x1874256841456512:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430795.362350:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10511:x1874256841456512:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 241us (426us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787430795.362358:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:3.0:1787430795.537529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.537621:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841456640 00000100:00100000:2.0:1787430795.537630:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841456640 00000100:00100000:2.0:1787430795.537690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:2.0:1787430795.537700:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10521:x1874256841456640:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:2.0:1787430795.537786:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537804:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537818:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537834:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537849:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537856:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537965:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537986:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.537993:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430795.538037:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538050:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538057:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538063:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538191:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.538197:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538205:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538217:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430795.538220:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.538225:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538231:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538251:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538256:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538261:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538266:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.538269:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538274:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538282:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430795.538285:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.538288:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538293:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538308:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538314:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538320:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538376:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.538379:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538386:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538395:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430795.538397:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.538401:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.538407:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430795.538499:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10521:x1874256841456640:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 798us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.538509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:1.0:1787430795.620638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.620755:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841456896 00000100:00100000:2.0:1787430795.620766:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841456896 00000100:00100000:2.0:1787430795.620832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00100000:2.0:1787430795.620843:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:10524:x1874256841456896:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430795.620866:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.620897:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146c6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.620983:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621014:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621034:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621058:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621066:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621401:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621547:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e694f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621555:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e694f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621563:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e694f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430795.621574:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787430795.621678:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621686:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621692:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621704:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.621708:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621716:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621728:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430795.621731:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.621735:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621741:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e694e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621753:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621759:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621765:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621770:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430795.621773:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621779:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621796:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430795.621799:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430795.621802:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.621808:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e694ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.626009:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e694e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146c6 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.626074:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e694f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146c6 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.626084:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430795.626087:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430795.626091:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74400, rc 0) 00000100:00100000:2.0:1787430795.626175:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+49:10524:x1874256841456896:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 5333us (5546us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787430795.626184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00100000:1.0:1787430795.631256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.632004:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841457024 00000100:00100000:0.0:1787430795.632015:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841457024 00000100:00100000:0.0:1787430795.632242:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:0.0:1787430795.632255:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+49:10524:x1874256841457024:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:0.0:1787430795.632356:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632375:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632386:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632413:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632419:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632425:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632430:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430795.632434:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632442:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632453:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:0.0:1787430795.632456:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430795.632460:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.632466:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430795.632551:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+49:10524:x1874256841457024:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 299us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.632559:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:3.0:1787430795.637963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.638324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841457280 00000100:00100000:2.0:1787430795.638349:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841457280 00000100:00100000:2.0:1787430795.638407:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:2.0:1787430795.638418:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+49:10524:x1874256841457280:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430795.638658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10524:x1874256841457280:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 242us (704us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787430795.638665:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:1.0:1787430795.801655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.801764:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841457536 00000100:00100000:0.0:1787430795.801774:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841457536 00000100:00100000:0.0:1787430795.801834:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:0.0:1787430795.801845:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:10534:x1874256841457536:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430795.801869:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430795.801873:0:9043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787430795.801912:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146aa expref: 50 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.801932:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:0.0:1787430795.801937:0:9043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430795.801951:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6950a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146cd expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.802053:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.802065:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.802084:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430795.802095:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787430795.802218:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6950a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146cd expref: 52 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.802248:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146cd expref: 51 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.802255:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:0.0:1787430795.802257:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430795.802260:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262a00, rc 0) 00000100:00100000:0.0:1787430795.802320:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10534:x1874256841457536:12345-192.168.204.60@tcp:101:bash.0 Request processed in 477us (673us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787430795.802374:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:1.0:1787430795.806034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.806185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841457792 00000100:00100000:2.0:1787430795.806196:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841457792 00000100:00100000:2.0:1787430795.806259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:2.0:1787430795.806269:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10534:x1874256841457792:12345-192.168.204.60@tcp:36:bash.0 00010000:00010000:2.0:1787430795.806388:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787430795.806416:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146cd expref: 51 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.806440:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e694f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146c6 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.806451:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430795.806456:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430795.806666:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.806680:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.806691:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430795.806741:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787430795.806766:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d597c0e reply state 0000000006d48643 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430795.806775:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430795.806946:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:10534:x1874256841457792:12345-192.168.204.60@tcp:36:bash.0 Request processed in 678us (921us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787430795.806954:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 104 00000020:00080000:2.0:1787430795.806968:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787430795.809623:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.809639:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.809647:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.809653:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430795.809658:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.809664:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.809679:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:1.0:1787430795.809682:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430795.809686:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.809709:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e6951f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.813512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430795.813610:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841457920 00000100:00100000:0.0:1787430795.813620:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841457920 00000100:00100000:0.0:1787430795.813674:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00100000:0.0:1787430795.813683:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:10534:x1874256841457920:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430795.813707:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430795.813738:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69526 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146d4 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.813822:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.813844:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.813856:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430795.813893:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787430795.813909:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430795.813932:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.813959:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69526 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 53 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.813976:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 52 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430795.813985:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:0.0:1787430795.813988:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430795.813992:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263c00, rc 0) 00000100:00100000:0.0:1787430795.814054:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:10534:x1874256841457920:12345-192.168.204.60@tcp:101:bash.0 Request processed in 370us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430795.814061:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00100000:3.0:1787430795.817806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.817956:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841458176 00000100:00100000:2.0:1787430795.817967:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841458176 00000100:00100000:2.0:1787430795.818024:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:2.0:1787430795.818034:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:10534:x1874256841458176:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:2.0:1787430795.818285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+53:10534:x1874256841458176:12345-192.168.204.60@tcp:35:bash.0 Request processed in 252us (487us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787430795.818294:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:1.0:1787430795.933393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.933818:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841458304 00000100:00100000:2.0:1787430795.933829:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841458304 00000100:00100000:2.0:1787430795.933903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 106 00000100:00100000:2.0:1787430795.933915:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+53:10540:x1874256841458304:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430795.933940:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.933961:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.934037:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6953b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.934051:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6953b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.934062:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6953b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430795.934125:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787430795.934130:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430795.934155:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6953b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.934203:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146db expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.934220:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6953b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146db expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.934229:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430795.934231:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430795.934235:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430795.934304:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841458304:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 391us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.934311:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 106 00000100:00100000:1.0:1787430795.941255:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430795.941386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841458432 00000100:00100000:3.0:1787430795.941396:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841458432 00000100:00100000:3.0:1787430795.941446:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:3.0:1787430795.941457:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841458432:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430795.941477:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430795.941498:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941586:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941600:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941611:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941627:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941634:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941641:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941742:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941751:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941759:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430795.941797:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787430795.941802:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430795.941835:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941860:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941868:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941875:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941893:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941898:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430795.941902:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941910:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941923:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430795.941926:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430795.941930:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941937:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69549 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941952:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941959:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941971:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941976:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430795.941979:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941986:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.941994:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430795.941997:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430795.942000:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.942006:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.942042:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e2 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.942056:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e2 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.942063:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:3.0:1787430795.942065:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430795.942068:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430795.942189:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:10540:x1874256841458432:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 732us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430795.942206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:0.0:1787430795.953529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.953630:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841458560 00000100:00100000:2.0:1787430795.953640:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841458560 00000100:00100000:2.0:1787430795.953699:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430795.953709:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:2374:x1874256841458560:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430795.953725:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430795.953750:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e2 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.953771:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430795.953776:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430795.953853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:2374:x1874256841458560:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 145us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430795.953861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:1.0:1787430795.968949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430795.969033:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841458816 00000100:00100000:2.0:1787430795.969056:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841458816 00000100:00100000:2.0:1787430795.969119:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:2.0:1787430795.969130:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841458816:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430795.969153:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430795.969175:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e6955e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146e9 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.969290:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.969306:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 55 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.969316:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.969387:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 55 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.969401:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 55 pid: 6884 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430795.969414:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856146816:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430795.969504:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7fc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430795.972765:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856146816:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430795.972794:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430795.976772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430795.977422:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841458944 00000100:00100000:3.0:1787430795.977433:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841458944 00010000:00010000:3.0:1787430795.977474:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 56 pid: 6884 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430795.977516:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:3.0:1787430795.977526:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+56:2373:x1874256841458944:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430795.977540:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430795.977547:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 56 pid: 6884 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.977560:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 56 pid: 6884 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.977581:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6952d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146d4 expref: 56 pid: 6884 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.977598:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:3.0:1787430795.977604:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.977613:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.977621:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.977667:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430795.977722:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:2373:x1874256841458944:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 196us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430795.977729:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 52 00010000:00010000:2.0:1787430795.977794:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.977808:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430795.977839:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787430795.978004:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e6955e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 56 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.978018:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 55 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430795.978026:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430795.978029:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787430795.978032:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74e00, rc 0) 00000100:00100000:2.0:1787430795.978071:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:10540:x1874256841458816:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 8943us (9132us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787430795.978078:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:1.0:1787430795.988288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430795.988370:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459200 00000100:00100000:3.0:1787430795.988380:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459200 00000100:00100000:3.0:1787430795.988446:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787430795.988457:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:10540:x1874256841459200:12345-192.168.204.60@tcp:103:lfs.0 00010000:00010000:3.0:1787430795.988472:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430795.988497:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e694c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146bf expref: 55 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430795.988516:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:3.0:1787430795.988521:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430795.988652:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841459200:12345-192.168.204.60@tcp:103:lfs.0 Request processed in 195us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430795.988659:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:0.0:1787430795.997703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430795.998595:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459328 00000100:00100000:1.0:1787430795.998606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459328 00000100:00100000:1.0:1787430795.998666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:1.0:1787430795.998677:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841459328:12345-192.168.204.60@tcp:58:lfs.0 00010000:00010000:1.0:1787430795.998844:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.998860:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430795.998871:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430795.999405:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787430795.999512:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841459328:12345-192.168.204.60@tcp:58:lfs.0 Request processed in 836us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430795.999521:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:1.0:1787430796.008109:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430796.008247:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459456 00000100:00100000:0.0:1787430796.008258:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459456 00000100:00100000:0.0:1787430796.008365:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 110 00000100:00100000:0.0:1787430796.008377:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:10540:x1874256841459456:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430796.008399:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430796.008420:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146f0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430796.008482:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430796.008509:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 55 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430796.008529:0:6884:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430796.008543:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 55 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430796.008555:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:0.0:1787430796.008559:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430796.008563:0:6884:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 55 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430796.008570:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263200, rc 0) 00000100:00100000:0.0:1787430796.008621:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:10540:x1874256841459456:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 247us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430796.008628:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 110 00000100:00080000:2.0:1787430796.008858:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787430796.316626:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430796.317038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430796.317084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430796.317126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430796.317149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430796.317234:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459712 00000100:00100000:2.0:1787430796.317243:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459712 00000100:00100000:2.0:1787430796.317307:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459840 00000100:00100000:2.0:1787430796.317311:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459840 00000100:00100000:2.0:1787430796.317370:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:2.0:1787430796.317382:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2372:x1874256841459712:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430796.317451:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2372:x1874256841459712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430796.317459:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:2.0:1787430796.317489:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:2.0:1787430796.317495:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2372:x1874256841459840:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430796.317523:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2372:x1874256841459840:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430796.317530:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00080000:2.0:1787430796.317547:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430796.318369:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459584 00000100:00100000:1.0:1787430796.318386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459584 00000100:00100000:1.0:1787430796.318421:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 269 00000100:00100000:1.0:1787430796.318429:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841459584:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430796.318466:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841459584:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430796.318473:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 269 00000100:00100000:1.0:1787430796.318619:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841459968 00000100:00100000:1.0:1787430796.318624:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841459968 00000100:00080000:1.0:1787430796.318647:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430796.318677:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 94 00000100:00100000:1.0:1787430796.318684:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841459968:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430796.318718:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2372:x1874256841459968:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430796.318724:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 94 00000001:00080000:2.0:1787430796.643690:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:2.0:1787430796.643707:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787430796.643730:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2c95c4300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787430796.643735:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c34d2600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2c95c40c0 00000020:00080000:2.0:1787430796.643738:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c34d2000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2fe6ed800 00000004:00080000:2.0:1787430796.643764:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787430796.643777:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2c56016c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787430796.643780:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c641f300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2c5601540 00000020:00080000:2.0:1787430796.643783:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c641f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2f7d67400 00000001:00080000:2.0:1787430796.643817:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:2.0:1787430796.643881:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787430796.644369:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787430796.644481:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856146944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787430796.644569:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430796.644649:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856146944 00000100:00100000:2.0:1787430796.644656:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856146944 00000100:00100000:2.0:1787430796.644706:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430796.644715:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856146944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787430796.644741:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787430796.644770:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.644793:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.644801:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787430796.644806:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430796.644811:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430796.645063:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856147072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787430796.645093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430796.645122:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856147072 00000100:00100000:3.0:1787430796.645125:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856147072 00000100:00100000:3.0:1787430796.645148:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787430796.645161:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856147072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787430796.645172:0:8633:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787430796.645193:0:8633:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a078a, atime: 0x6a8a078a, ctime: 0x6a8a078a, blocks: 0x1 00010000:00010000:3.0:1787430796.645199:0:8633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645209:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=260s v=(0 0) 00010000:00010000:3.0:1787430796.645212:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430796.645218:0:8633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645233:0:8633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645243:0:8633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645251:0:8633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645268:0:8633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787430796.645700:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874256856147072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 539us (604us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787430796.645708:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1787430796.645733:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430796.645740:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645759:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430796.645764:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645774:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645788:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645795:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a076b8d/0x1fa5b1e070e69588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.645813:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430796.645815:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430796.645817:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787430796.645861:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2fee95500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787430796.645877:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856147072:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1787430796.645915:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787430796.646281:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.646298:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 7 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430796.646311:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1874256856147200:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430796.646406:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430796.653073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430796.653108:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841460096 00000100:00100000:1.0:1787430796.653116:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841460096 00010000:00010000:1.0:1787430796.653153:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430796.653185:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:1.0:1787430796.653194:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841460096:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430796.653207:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430796.653214:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.653246:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.653271:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430796.653275:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430796.653282:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.653291:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.653311:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430796.653382:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841460096:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 187us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430796.653389:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00010000:00010000:3.0:1787430796.655483:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e693c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14680 expref: 7 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430796.655507:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1874256856147200:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430796.655529:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.655555:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.655562:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.655573:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.655581:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430796.655601:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787430796.656313:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874256856146944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11596us (11741us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787430796.656323:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1787430796.656797:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2feb3f100/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787430796.656804:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feb3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856146944:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787430796.657369:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430796.657378:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.657390:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430796.657395:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.657406:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.657440:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.657447:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086edc84/0x1fa5b1e070e69581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.657468:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430796.657470:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430796.657472:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430796.961741:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430796.961751:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430796.961817:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787430796.961824:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430796.961985:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856147328:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430796.962119:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430796.974081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430796.974232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841460224 00000100:00100000:3.0:1787430796.974241:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841460224 00000100:00100000:3.0:1787430796.974306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 111 00000100:00100000:3.0:1787430796.974316:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841460224:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430796.974375:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430796.974489:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841460224:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 173us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430796.974497:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 111 00000100:00100000:2.0:1787430796.975786:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856147328:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430796.981897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430796.982375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841460352 00000100:00100000:1.0:1787430796.982385:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841460352 00000100:00100000:1.0:1787430796.982445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 112 00000100:00100000:1.0:1787430796.982456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10541:x1874256841460352:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787430796.982532:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982559:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982573:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982611:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982620:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982648:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982689:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982699:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982707:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430796.982760:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787430796.982765:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430796.982779:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982791:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982797:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982803:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982810:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430796.982816:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982823:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982845:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430796.982848:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430796.982852:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982868:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6958f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982881:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982887:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982892:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982898:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430796.982901:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982907:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982914:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa0f2d0ce5e00) 00010000:00010000:1.0:1787430796.982916:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430796.982919:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982923:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69596 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982950:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982956:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982962:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982966:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430796.982968:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982974:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982982:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:1.0:1787430796.982984:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430796.982987:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430796.982993:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6959d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430796.983095:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10541:x1874256841460352:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 Request processed in 639us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430796.983104:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 112 00000100:00100000:1.0:1787430796.992473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430796.992577:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841460608 00000100:00100000:2.0:1787430796.992587:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841460608 00000100:00100000:2.0:1787430796.992644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:2.0:1787430796.992653:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10541:x1874256841460608:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430796.992672:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430796.992702:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.992816:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.992831:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.992842:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430796.992854:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787430796.993236:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993244:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993250:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993255:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430796.993272:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993280:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993295:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430796.993298:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430796.993303:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993309:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993398:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f7 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993409:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:2.0:1787430796.993411:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430796.993415:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f7 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430796.993425:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75400, rc 0) 00000100:00100000:2.0:1787430796.994124:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841460608:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1469us (1657us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787430796.994134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:2.0:1787430797.002646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.002986:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841460736 00000100:00100000:0.0:1787430797.002996:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841460736 00000100:00100000:0.0:1787430797.003142:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:0.0:1787430797.003154:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841460736:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430797.003190:0:6884:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430797.003294:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841460736:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 142us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.003302:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:1.0:1787430797.006622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430797.008082:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841460992 00000100:00100000:2.0:1787430797.008094:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841460992 00000100:00100000:2.0:1787430797.008153:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 115 00000100:00100000:2.0:1787430797.008175:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841460992:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430797.008194:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430797.008197:0:9043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787430797.008220:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e6953b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146db expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.008237:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:2.0:1787430797.008242:0:9043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430797.008253:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc146fe expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430797.009055:0:9043:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787430797.009298:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e695c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.009313:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e695c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.009354:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e695c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.009419:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e695b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146fe expref: 16 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.009434:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e695c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146fe expref: 15 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.009442:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430797.009445:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430797.009455:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430797.009533:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841460992:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1359us (2919us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787430797.009541:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 115 00000100:00100000:1.0:1787430797.020960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430797.021260:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841461248 00000100:00100000:2.0:1787430797.021271:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841461248 00000100:00100000:2.0:1787430797.021351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 116 00000100:00100000:2.0:1787430797.021364:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841461248:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787430797.021440:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430797.021468:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e695c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146fe expref: 15 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.021489:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430797.021499:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430797.021522:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.021538:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.021548:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.021607:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.021615:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.021623:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022782:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022796:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022802:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022809:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430797.022813:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022820:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022832:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:3.0:1787430797.022835:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430797.022839:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022845:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e695ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022855:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022874:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022879:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022894:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430797.022897:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022903:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022911:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd7106eb1 (ffffa0f2d22f0e00) 00010000:00010000:3.0:1787430797.022913:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430797.022915:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.022920:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e695d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd7106eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.023015:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841461248:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 1651us (2063us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430797.023023:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 116 00000100:00100000:3.0:1787430797.031042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.038415:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841461376 00000100:00100000:3.0:1787430797.038432:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841461376 00000100:00100000:3.0:1787430797.038503:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 117 00000100:00100000:3.0:1787430797.038513:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841461376:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.038544:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430797.038567:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e695dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14705 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.038606:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.038632:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.038644:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.038761:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e695dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 16 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.038783:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 15 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.038791:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430797.038794:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430797.038798:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430797.038869:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841461376:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 347us (7826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.038877:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 117 00000100:00100000:2.0:1787430797.046155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.046219:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841461632 00000100:00100000:3.0:1787430797.046229:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841461632 00000100:00100000:3.0:1787430797.046286:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 118 00000100:00100000:3.0:1787430797.046298:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841461632:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.046611:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.046627:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.046650:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430797.047222:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787430797.047233:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 260601905256ns, next at 261601903210ns, rc = 0 00000004:00010000:3.0:1787430797.047312:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcb5568 reply state 000000005da21110 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.047322:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430797.047446:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10541:x1874256841461632:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 1149us (1299us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787430797.047454:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 118 00010000:00010000:2.0:1787430797.055939:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.055958:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.055967:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.055974:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430797.055980:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.055988:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.056006:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:2.0:1787430797.056009:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787430797.056014:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.056020:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.057434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.057510:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841461760 00000100:00100000:3.0:1787430797.057519:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841461760 00000100:00100000:3.0:1787430797.058821:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:3.0:1787430797.058836:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10541:x1874256841461760:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.058868:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430797.058888:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1470c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.058947:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.058959:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.058979:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430797.058989:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430797.058994:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430797.059115:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10541:x1874256841461760:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 283us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.059122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:1.0:1787430797.069981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.070061:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841461888 00000100:00100000:3.0:1787430797.070071:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841461888 00000100:00100000:3.0:1787430797.070133:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:3.0:1787430797.070144:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841461888:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787430797.071289:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841461888:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 1143us (1313us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787430797.071300:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:1.0:1787430797.091649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430797.091758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841462144 00000100:00100000:2.0:1787430797.091768:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841462144 00000100:00100000:2.0:1787430797.091830:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:2.0:1787430797.091842:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:10541:x1874256841462144:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787430797.094300:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10541:x1874256841462144:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 2456us (2656us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787430797.094311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:3.0:1787430797.097183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430797.097656:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841462400 00000100:00100000:1.0:1787430797.097667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841462400 00000100:00100000:1.0:1787430797.097752:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 120 00000100:00100000:1.0:1787430797.097763:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10541:x1874256841462400:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787430797.097908:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10541:x1874256841462400:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 146us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430797.097916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 120 00000001:00080000:1.0:1787430797.110584:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787430797.110603:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787430797.110609:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787430797.110615:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:1.0:1787430797.114321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.114450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841462528 00000100:00100000:3.0:1787430797.114462:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841462528 00000100:00100000:3.0:1787430797.114532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 121 00000100:00100000:3.0:1787430797.114551:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10541:x1874256841462528:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.114572:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430797.114593:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e695f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14713 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.114666:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.114853:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.114877:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430797.114924:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430797.114942:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.114970:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e695f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14713 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.114989:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14713 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.114999:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430797.115002:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787430797.115005:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147ae00, rc 0) 00000100:00100000:3.0:1787430797.115065:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10541:x1874256841462528:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 516us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.115072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 121 00000100:00100000:3.0:1787430797.126830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.126927:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841462656 00000100:00100000:0.0:1787430797.126937:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841462656 00000100:00100000:0.0:1787430797.126989:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:0.0:1787430797.126998:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841462656:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430797.127016:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430797.127035:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1471a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430797.127074:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a078c, blocks: 0x1 00010000:00010000:0.0:1787430797.127093:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1787430797.127098:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430797.127107:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.127124:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.127138:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262c00, rc 0) 00000100:00100000:0.0:1787430797.127197:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841462656:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 200us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.127204:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:2.0:1787430797.137432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.137533:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841462912 00000100:00100000:0.0:1787430797.137543:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841462912 00000100:00100000:0.0:1787430797.137606:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00100000:0.0:1787430797.137618:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10541:x1874256841462912:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787430797.137782:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10541:x1874256841462912:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 165us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.137801:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00100000:1.0:1787430797.148569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.148836:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463040 00000100:00100000:3.0:1787430797.148848:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463040 00000100:00100000:3.0:1787430797.148916:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:3.0:1787430797.148927:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:10541:x1874256841463040:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.148944:0:8633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430797.148960:0:8633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14721 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.148992:0:8633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.149014:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430797.149019:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430797.149026:0:8633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 8 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.149075:0:8633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.149089:0:8633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.149105:0:8633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feafa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8633:1874256856147456:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430797.149197:0:8633:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858840 going to sleep for 11 seconds 00000100:00100000:3.0:1787430797.156272:0:8633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feafa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8633:1874256856147456:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430797.156313:0:8633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 8 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.156364:0:8633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b600, rc 0) 00000100:00100000:3.0:1787430797.156424:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:10541:x1874256841463040:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 7498us (7865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.156433:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:2.0:1787430797.163529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430797.163691:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463168 00000100:00100000:1.0:1787430797.163701:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463168 00010000:00010000:1.0:1787430797.163750:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430797.163791:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:1.0:1787430797.163801:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841463168:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430797.163815:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430797.163840:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.163853:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.163901:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e69606 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1471a expref: 8 pid: 6683 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.163918:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430797.163923:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430797.163931:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.163941:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.163980:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430797.163995:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1874256856147584:192.168.204.60@tcp:105: 00000100:00100000:1.0:1787430797.164297:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6593900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430797.177209:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1874256856147584:192.168.204.60@tcp:105: 00010000:00010000:0.0:1787430797.177238:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430797.183199:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841463168:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 19388us (19668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.183215:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:1.0:1787430797.185350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430797.185445:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463296 00000100:00100000:2.0:1787430797.185455:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463296 00002000:00100000:2.0:1787430797.185505:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0f2ec167100 x1874256841463296/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:18/0 lens 504/0 e 0 to 0 dl 1787430808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430797.185517:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2ec167100 with x1874256841463296 ext(0->12) 00002000:00010000:2.0:1787430797.185523:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2ec167100 00000100:00100000:2.0:1787430797.185544:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:2.0:1787430797.185554:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841463296:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787430797.186545:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2373:x1874256841463296:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 Request processed in 988us (1212us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787430797.186556:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00002000:00100000:2.0:1787430797.186565:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0f2ec167100 x1874256841463296/t4294967309(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:18/0 lens 504/448 e 0 to 0 dl 1787430808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430797.186574:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2ec167100 with x1874256841463296 ext(0->12) 00002000:00010000:2.0:1787430797.186579:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2ec167100 00000100:00100000:2.0:1787430797.200952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.201887:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463424 00000100:00100000:3.0:1787430797.201897:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463424 00000100:00100000:3.0:1787430797.201960:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:3.0:1787430797.201982:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:10541:x1874256841463424:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787430797.286519:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1787430797.286543:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:0.0:1787430797.286575:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787430797.286655:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1787430797.286669:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787430797.287214:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430797.287234:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856147712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787430797.287302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430797.287525:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856147712 00000100:00100000:1.0:1787430797.287533:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856147712 00000100:00100000:1.0:1787430797.287585:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787430797.287596:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856147712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787430797.287767:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787430797.287771:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787430796 00002000:00010000:1.0:1787430797.287774:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787430797.287777:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787430796 -> 1787430796 00002000:00010000:1.0:1787430797.287792:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787430797.287844:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856147712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (541us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787430797.287862:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787430797.287996:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787430797.288001:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967307 00000004:00080000:0.0:1787430797.288017:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2feb3f100, transno 4294967307 00000100:00100000:0.0:1787430797.288042:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0f2ec167b80 x1874256856147712/t4294967310(4294967310) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787430813 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787430797.288054:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2ec167b80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787430797.288059:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec167b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856147712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787430797.288875:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841463424:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 Request processed in 86890us (87928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430797.288885:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:2.0:1787430797.293917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430797.294018:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463552 00000100:00100000:1.0:1787430797.294026:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463552 00000100:00100000:1.0:1787430797.294129:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:1.0:1787430797.294140:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841463552:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787430797.340959:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787430797.342307:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787430797.342359:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1787430797.347443:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841463552:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 Request processed in 53293us (53524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430797.347459:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:1.0:1787430797.368626:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.368718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463808 00000100:00100000:3.0:1787430797.368744:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463808 00000100:00100000:3.0:1787430797.368801:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 124 00000100:00100000:3.0:1787430797.368812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841463808:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.368884:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430797.368911:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e695ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14713 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.368934:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430797.368939:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430797.368969:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.368981:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.368990:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430797.369260:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fe763db reply state 00000000b360e243 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.369304:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430797.369429:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:10541:x1874256841463808:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 618us (815us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787430797.369438:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 124 00010000:00010000:1.0:1787430797.378942:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.378959:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.378967:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.378973:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430797.378979:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.378986:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.379004:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:1.0:1787430797.379019:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430797.379025:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.379041:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430797.380714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.380817:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841463936 00000100:00100000:0.0:1787430797.380827:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841463936 00000100:00100000:0.0:1787430797.380891:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:0.0:1787430797.380902:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841463936:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787430797.381174:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787430797.381178:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787430796 -> 1787430795 00002000:00010000:0.0:1787430797.381181:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787430794 00002000:00010000:0.0:1787430797.381183:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787430796 -> 1787430795 00002000:00010000:0.0:1787430797.381185:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787430797.381249:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841463936:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 348us (543us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787430797.381256:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:0.0:1787430797.390923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430797.390995:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841464192 00000100:00100000:1.0:1787430797.391004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841464192 00000100:00100000:1.0:1787430797.391068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 125 00000100:00100000:1.0:1787430797.391079:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:10541:x1874256841464192:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787430797.391157:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.391174:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 15 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.391184:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.391221:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 15 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.391236:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 15 pid: 6884 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430797.391250:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec166300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856147840:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430797.391372:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430797.397497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.401010:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841464320 00000100:00100000:3.0:1787430797.401026:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841464320 00010000:00010000:3.0:1787430797.401089:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 16 pid: 6884 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.401131:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:3.0:1787430797.401142:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:2374:x1874256841464320:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430797.401157:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430797.401165:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 16 pid: 6884 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.401179:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 16 pid: 6884 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.401203:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:3.0:1787430797.401209:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.401218:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.401225:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.401244:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430797.401315:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:2374:x1874256841464320:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 175us (3829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.401323:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 55 00010000:00010000:1.0:1787430797.404963:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e695e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14705 expref: 15 pid: 6884 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430797.404992:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec166300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856147840:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430797.405017:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408101:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408117:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408156:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408164:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408172:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408179:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430797.408183:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408190:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408209:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:2.0:1787430797.408212:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787430797.408216:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.408222:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6961b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.408367:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841464192:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 Request processed in 17284us (17447us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787430797.408377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 125 00000100:00100000:2.0:1787430797.411602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.411862:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841464448 00000100:00100000:3.0:1787430797.411885:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841464448 00000100:00100000:3.0:1787430797.411939:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:3.0:1787430797.411948:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c34f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841464448:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787430797.411988:0:8633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.412008:0:8633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.412016:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430797.412020:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430797.412025:0:8633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.412072:0:8633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 7 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.412086:0:8633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 7 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.412101:0:8633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feafa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8633:1874256856147968:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430797.412183:0:8633:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858540 going to sleep for 11 seconds 00000100:00100000:3.0:1787430797.415783:0:8633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feafa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8633:1874256856147968:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430797.415812:0:8633:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.425607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.426765:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841464576 00000100:00100000:3.0:1787430797.426778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841464576 00010000:00010000:3.0:1787430797.426821:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430797.426875:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:3.0:1787430797.426887:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841464576:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430797.426901:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430797.426925:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.426940:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.426964:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c226cc/0x1fa5b1e070e6960d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14721 expref: 8 pid: 8633 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.426983:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430797.426987:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430797.426993:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.427004:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430797.427071:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430797.427142:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841464576:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 257us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.427151:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00010000:00010000:0.0:1787430797.428417:0:8633:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428432:0:8633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428468:0:8633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428477:0:8633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428483:0:8633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428491:0:8633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430797.428495:0:8633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428518:0:8633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428536:0:8633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.428544:0:8633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a076b8d/0x1fa5b1e070e69622 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430797.428635:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c34f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841464448:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 Request processed in 16685us (17040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.428645:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:2.0:1787430797.430972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430797.431479:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841464832 00000100:00100000:3.0:1787430797.431492:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841464832 00000100:00100000:3.0:1787430797.431567:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 126 00000100:00100000:3.0:1787430797.431578:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10541:x1874256841464832:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787430797.432014:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432042:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432053:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432289:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432301:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432309:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432378:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.432393:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 15 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.432420:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856148096:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430797.432510:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c785e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430797.437360:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856148096:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430797.437392:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.437533:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.440429:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841464960 00000100:00100000:0.0:1787430797.440443:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841464960 00010000:00010000:0.0:1787430797.440495:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430797.440537:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:0.0:1787430797.440548:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:2374:x1874256841464960:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430797.440563:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430797.440570:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.440601:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.440621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e695f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1470c expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.440642:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:0.0:1787430797.440649:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.440657:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.440665:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.440701:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430797.440783:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:2374:x1874256841464960:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 236us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.440790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00010000:00010000:2.0:1787430797.440956:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.440965:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430797.441160:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787430797.441288:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787430797.441361:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787430797.441450:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856148224:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787430797.441509:0:9043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430797.441543:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c609a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430797.444221:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856148224 00000100:00100000:0.0:1787430797.444235:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856148224 00000100:00100000:0.0:1787430797.444299:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430797.444309:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9043:x1874256856148224:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787430797.444450:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9043:x1874256856148224:12345-0@lo:1000:mdt00_004.0 Request processed in 141us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.444458:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430797.444518:0:9043:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787430797.444524:0:9043:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2ec167b80, transno 4294967310 00000100:00100000:0.0:1787430797.444540:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856148224:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1787430797.445226:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787430797.445300:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856148352:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787430797.445372:0:9043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430797.445398:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7fc6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787430797.445557:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856148352 00000100:00100000:0.0:1787430797.445563:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856148352 00000100:00100000:0.0:1787430797.445588:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430797.445595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9043:x1874256856148352:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787430797.446249:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9043:x1874256856148352:12345-0@lo:1000:mdt00_004.0 Request processed in 651us (874us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787430797.446259:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787430797.446362:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856148352:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787430797.446398:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446409:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446415:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446422:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430797.446426:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446447:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446462:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2daf05b00) 00010000:00010000:2.0:1787430797.446465:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430797.446470:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446476:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69630 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446505:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446511:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446517:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446522:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430797.446524:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446530:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446538:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430797.446540:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430797.446548:0:9043:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 18 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446570:0:9043:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 18 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446580:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 18 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.446611:0:9043:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 18 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.446623:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856148480:192.168.204.60@tcp:105: 00000100:00100000:2.0:1787430797.454280:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c9e21180 going to sleep for 11 seconds 00000100:00100000:1.0:1787430797.458288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430797.458448:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856148480:192.168.204.60@tcp:105: 00010000:00010000:2.0:1787430797.458480:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458490:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4c00/0x1fa5b1e070e69573 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458522:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458537:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458550:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458561:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458580:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458587:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458593:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430797.458597:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458605:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458616:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430797.458619:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430797.458623:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458628:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69637 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458639:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458644:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458649:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458655:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430797.458662:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458668:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458691:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430797.458694:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430797.458696:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.458702:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e69629 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.458934:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10541:x1874256841464832:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 27356us (27969us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787430797.458944:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 126 00000020:00080000:2.0:1787430797.458950:0:9043:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787430797.459202:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430797.459207:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430797.459789:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787430797.459798:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430797.462240:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841465088 00000100:00100000:3.0:1787430797.462253:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841465088 00000100:00100000:3.0:1787430797.462404:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:3.0:1787430797.462416:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10540:x1874256841465088:12345-192.168.204.60@tcp:49:lfs.0 00000100:00100000:3.0:1787430797.462552:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10540:x1874256841465088:12345-192.168.204.60@tcp:49:lfs.0 Request processed in 138us (4273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430797.462560:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:2.0:1787430797.462694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.463587:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841465344 00000100:00100000:0.0:1787430797.463595:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841465344 00000100:00100000:0.0:1787430797.463628:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:0.0:1787430797.463636:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:10541:x1874256841465344:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787430797.464509:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787430797.464617:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787430797.464669:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.464696:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.464715:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.464731:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.464737:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.464744:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.464760:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787430797.464844:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:10541:x1874256841465344:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 1207us (2148us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787430797.464863:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000020:00080000:0.0:1787430797.464868:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787430797.470448:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430797.470463:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.470474:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430797.470479:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.470489:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.470507:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430797.470510:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787430797.470515:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.470520:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6963e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.470545:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430797.470547:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430797.470548:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430797.475196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.475493:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841465600 00000100:00100000:0.0:1787430797.475504:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841465600 00000100:00100000:0.0:1787430797.475556:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:0.0:1787430797.475567:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:10540:x1874256841465600:12345-192.168.204.60@tcp:58:lfs.0 00000040:00080000:0.0:1787430797.475860:0:6884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787430797.476289:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:10540:x1874256841465600:12345-192.168.204.60@tcp:58:lfs.0 Request processed in 722us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430797.476299:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:2.0:1787430797.511367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.511471:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841465728 00000100:00100000:0.0:1787430797.511481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841465728 00000100:00100000:0.0:1787430797.511542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:0.0:1787430797.511551:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:10543:x1874256841465728:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430797.511581:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430797.511603:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e69645 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.511675:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.511702:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.511715:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.511743:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.511751:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.511758:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.512220:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.512234:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 21 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.512243:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.512276:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 21 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430797.512296:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 21 pid: 9043 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430797.512312:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856148608:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430797.517319:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c571b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430797.520717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430797.521052:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841465984 00000100:00100000:0.0:1787430797.521062:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841465984 00000100:00100000:0.0:1787430797.521122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:0.0:1787430797.521133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:5605:x1874256841465984:12345-192.168.204.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787430797.521413:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:5605:x1874256841465984:12345-192.168.204.60@tcp:35:ldlm_bl.0 Request processed in 281us (705us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787430797.521422:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:2.0:1787430797.521523:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856148608:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430797.521549:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430797.525502:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430797.525609:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841466112 00000100:00100000:2.0:1787430797.525620:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841466112 00010000:00010000:2.0:1787430797.525663:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 23 pid: 9043 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.525908:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:2.0:1787430797.525919:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:2374:x1874256841466112:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430797.525934:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430797.525941:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 23 pid: 9043 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.525954:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 23 pid: 9043 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.525975:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69565 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146e9 expref: 23 pid: 9043 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.525991:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430797.525997:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.526005:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.526013:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430797.526086:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430797.526150:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:2374:x1874256841466112:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 231us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430797.526158:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 58 00010000:00010000:1.0:1787430797.531770:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.531791:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430797.531847:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787430797.531877:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430797.531901:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.531918:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.531928:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430797.534472:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430797.534510:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856148736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430797.534581:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430797.534632:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856148736 00000100:00100000:2.0:1787430797.534639:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856148736 00000100:00100000:2.0:1787430797.534703:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787430797.534713:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874256856148736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430797.534747:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430797.534790:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874256856148736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430797.534797:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787430797.534818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430797.534866:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856148736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787430797.537555:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537565:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537572:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430797.537577:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537586:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537603:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430797.537606:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430797.537618:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537624:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6964c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537642:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537648:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537654:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537659:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430797.537662:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537668:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537677:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0f2d2bc4b00) 00010000:00010000:1.0:1787430797.537679:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430797.537682:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537688:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537747:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e69645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14728 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537774:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14728 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430797.537786:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:1.0:1787430797.537789:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430797.537791:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263400, rc 0) 00000100:00100000:1.0:1787430797.538005:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:10543:x1874256841465728:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 26452us (26682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430797.538014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 128 00000001:00080000:3.0:1787430797.587942:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1787430797.587964:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787430797.587972:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:0.0:1787430798.366453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430798.493053:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430798.493062:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430798.493114:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787430798.493122:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430798.493255:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856148864:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787430798.493392:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c619c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430798.501114:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430798.501234:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841466240 00000100:00100000:3.0:1787430798.501244:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841466240 00000100:00100000:3.0:1787430798.501315:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 129 00000100:00100000:3.0:1787430798.501354:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:10554:x1874256841466240:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430798.501412:0:9043:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430798.501516:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:10554:x1874256841466240:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 191us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430798.501530:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 129 00000100:00080000:2.0:1787430798.501946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430798.502602:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856148864:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430798.519725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430798.519901:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841466496 00000100:00100000:2.0:1787430798.519913:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841466496 00000100:00100000:2.0:1787430798.519978:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 130 00000100:00100000:2.0:1787430798.519988:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:10554:x1874256841466496:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430798.520009:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430798.520032:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69661 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1472f expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430798.520148:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430798.520163:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430798.520194:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430798.520206:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787430798.520354:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69661 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1472f expref: 24 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430798.520372:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1472f expref: 23 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430798.520380:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430798.520383:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430798.520387:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430798.520458:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:10554:x1874256841466496:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 471us (744us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787430798.520466:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 130 00000100:00100000:2.0:1787430798.535303:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430798.535360:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430798.535384:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841466624 00000100:00100000:2.0:1787430798.535393:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841466624 00000100:00100000:2.0:1787430798.535443:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430798.535452:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:2374:x1874256841466624:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430798.535465:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430798.535488:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1472f expref: 23 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430798.535518:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:2.0:1787430798.535524:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430798.535568:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:2374:x1874256841466624:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 117us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430798.535576:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787430798.537031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841466880 00000100:00100000:3.0:1787430798.537042:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841466880 00000100:00100000:3.0:1787430798.537107:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 131 00000100:00100000:3.0:1787430798.537116:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:10554:x1874256841466880:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787430798.537197:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537215:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537226:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537484:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537492:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537498:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537504:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430798.537508:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537514:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537535:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:3.0:1787430798.537538:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430798.537542:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.537549:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69676 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430798.537704:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:10554:x1874256841466880:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 587us (2409us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787430798.537712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 131 00000040:00080000:0.0:1787430798.538114:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430798.538119:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430798.538636:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787430798.538646:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430798.555259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430798.555449:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841467136 00000100:00100000:0.0:1787430798.555474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841467136 00000100:00100000:0.0:1787430798.555533:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:0.0:1787430798.555545:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:10554:x1874256841467136:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787430798.555797:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:10554:x1874256841467136:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 254us (547us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787430798.555806:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:1.0:1787430798.557485:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430798.557506:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856148992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430798.557567:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430798.557628:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856148992 00000100:00100000:1.0:1787430798.557635:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856148992 00000100:00100000:1.0:1787430798.557697:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430798.557706:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856148992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430798.557737:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430798.557779:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856148992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.557787:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787430798.557819:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430798.557876:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856148992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430798.561218:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856149248:0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.561284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430798.561354:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787430798.561362:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856149120:0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.561392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430798.561417:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856149632:0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.561439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430798.561466:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856149376:0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.561488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430798.561512:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430798.561518:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856149504:0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.561542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430798.561572:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149248 00000100:00100000:1.0:1787430798.561579:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149248 00000100:00100000:1.0:1787430798.561618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149632 00000100:00100000:1.0:1787430798.561621:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149632 00000100:00100000:1.0:1787430798.561649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149376 00000100:00100000:1.0:1787430798.561651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149376 00000100:00100000:1.0:1787430798.561670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430798.561946:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856149248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430798.562090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787430798.562099:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856149632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.562963:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856149248:12345-0@lo:400:kworker.0 Request processed in 1019us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.562973:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787430798.562994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787430798.563002:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856149376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.563042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec166300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856149376:12345-0@lo:400:kworker.0 Request processed in 43us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.563048:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787430798.563065:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149120 00000100:00100000:1.0:1787430798.563078:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149120 00000100:00100000:1.0:1787430798.563107:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787430798.563114:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856149120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430798.574475:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856149632:12345-0@lo:400:kworker.0 Request processed in 12368us (13025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430798.574491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787430798.581005:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856149120:12345-0@lo:400:kworker.0 Request processed in 17881us (19602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.581031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787430798.581107:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149504 00000100:00100000:1.0:1787430798.581116:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149504 00000100:00100000:1.0:1787430798.581169:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787430798.581179:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856149504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.581252:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec167b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856149504:12345-0@lo:400:kworker.0 Request processed in 76us (19709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430798.581259:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787430798.581296:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430798.581455:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787430798.581461:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787430798.581482:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2fee95500, transno 4294967304 00000100:00100000:1.0:1787430798.581499:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856149504:0@lo:400:kworker.0 00000100:00100000:1.0:1787430798.581515:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856149376:0@lo:400:kworker.0 00000100:00100000:0.0:1787430798.590808:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856149248:0@lo:400:kworker.0 00000100:00100000:0.0:1787430798.590899:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856149120:0@lo:400:kworker.0 00000100:00100000:0.0:1787430798.590914:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856149632:0@lo:400:kworker.0 00000040:00080000:2.0:1787430798.699151:0:12112:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430798.699162:0:12112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430798.699213:0:12112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787430798.699219:0:12112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430798.922580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430798.922651:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841467392 00000100:00100000:3.0:1787430798.922662:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841467392 00000100:00100000:3.0:1787430798.922736:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:3.0:1787430798.922749:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:10567:x1874256841467392:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430798.922775:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430798.922921:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6967d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14736 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.923049:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69684 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.923073:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69684 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.923084:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69684 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430798.923097:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787430798.923230:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6967d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14736 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.923251:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14736 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.923260:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:3.0:1787430798.923263:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787430798.923267:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a800, rc 0) 00000100:00100000:3.0:1787430798.923353:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:10567:x1874256841467392:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 578us (755us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787430798.923361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:0.0:1787430798.932981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430798.933140:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841467520 00000100:00100000:3.0:1787430798.933150:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841467520 00000100:00100000:3.0:1787430798.933213:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:3.0:1787430798.933224:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:10567:x1874256841467520:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:3.0:1787430798.933301:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933319:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933364:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933391:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933399:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933406:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933412:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430798.933417:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933425:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933437:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:3.0:1787430798.933440:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430798.933445:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430798.933450:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430798.933526:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:10567:x1874256841467520:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 303us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430798.933534:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:3.0:1787430799.114471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430799.114600:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841467648 00000100:00100000:1.0:1787430799.114611:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841467648 00000100:00100000:1.0:1787430799.114712:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:1.0:1787430799.114724:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841467648:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:1.0:1787430799.114743:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430799.114762:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69699 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1473d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430799.114801:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a078b, atime: 0x6a8a078a, ctime: 0x6a8a078b, blocks: 0xb 00010000:00010000:1.0:1787430799.114831:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=262s v=(0 0) 00010000:00010000:1.0:1787430799.114836:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430799.114847:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1473d expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430799.114867:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1473d expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430799.114880:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4c00, rc 0) 00000100:00100000:1.0:1787430799.114946:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841467648:12345-192.168.204.60@tcp:101:cat.0 Request processed in 224us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430799.114954:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00080000:2.0:1787430799.115152:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430799.122154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430799.122275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841467776 00000100:00100000:0.0:1787430799.122285:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841467776 00002000:00100000:0.0:1787430799.122364:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa0f2feafad80 x1874256841467776/t0(0) o3->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:20/0 lens 488/0 e 0 to 0 dl 1787430810 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430799.122375:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2feafad80 with x1874256841467776 ext(0->4095) 00002000:00010000:0.0:1787430799.122381:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2feafad80 00000100:00100000:0.0:1787430799.122416:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:0.0:1787430799.122427:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2372:x1874256841467776:12345-192.168.204.60@tcp:3:cat.0 00000100:00100000:0.0:1787430799.122649:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2372:x1874256841467776:12345-192.168.204.60@tcp:3:cat.0 Request processed in 223us (504us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787430799.122658:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00002000:00100000:0.0:1787430799.122665:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa0f2feafad80 x1874256841467776/t0(0) o3->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:20/0 lens 488/4536 e 0 to 0 dl 1787430810 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430799.122685:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2feafad80 with x1874256841467776 ext(0->4095) 00002000:00010000:0.0:1787430799.122701:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2feafad80 00010000:00010000:2.0:1787430799.388537:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430800.412481:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430800.606560:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430800.606568:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430800.606602:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787430800.606608:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430801.435234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430801.435290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430801.435321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430801.435361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430801.435381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430801.435412:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468160 00000100:00100000:3.0:1787430801.435422:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468160 00000100:00100000:3.0:1787430801.435478:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468288 00000100:00100000:3.0:1787430801.435481:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468288 00000100:00100000:3.0:1787430801.435506:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:3.0:1787430801.435517:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841468160:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430801.435590:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841468160:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430801.435598:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:3.0:1787430801.435613:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:3.0:1787430801.435621:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841468288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430801.435740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841467904 00000100:00100000:0.0:1787430801.435744:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841467904 00000100:00100000:0.0:1787430801.435787:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 271 00000100:00100000:0.0:1787430801.435795:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841467904:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430801.435822:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841467904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430801.435829:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 271 00000100:00100000:3.0:1787430801.435903:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841468288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 284us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430801.435910:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:3.0:1787430801.435926:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468416 00000100:00100000:3.0:1787430801.435929:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468416 00000100:00100000:3.0:1787430801.435963:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468032 00000100:00100000:3.0:1787430801.435967:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468032 00000100:00100000:3.0:1787430801.435987:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 98 00000100:00100000:3.0:1787430801.435994:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841468416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430801.436022:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841468416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430801.436040:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 98 00000100:00100000:3.0:1787430801.436053:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:3.0:1787430801.436058:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:2374:x1874256841468032:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430801.436080:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:2374:x1874256841468032:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 22us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430801.436085:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00080000:3.0:1787430801.436108:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787430801.436113:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787430801.436115:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430801.438511:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430802.462838:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430802.659671:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856149760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430802.659746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430802.659858:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149760 00000100:00100000:0.0:1787430802.659866:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149760 00000100:00100000:0.0:1787430802.659923:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787430802.659945:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856149760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787430802.659978:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430802.660021:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856149760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430802.660028:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787430802.660580:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856149760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787430802.660691:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787430802.742038:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1787430802.742056:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787430802.777955:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1787430802.778003:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2f7fc6cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787430802.778009:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2d04ef800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2f7fc6840 00000020:00080000:0.0:1787430802.778012:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2d04ef900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2d8254000 00000001:00080000:0.0:1787430802.778046:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787430802.778142:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787430802.778463:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787430803.484606:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430803.682570:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856149888:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.682666:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.682713:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856150400:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.682751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.682778:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787430803.682784:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856150016:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.682807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.682823:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856150528:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.682847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.682893:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856150144:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.682931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.682949:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856150656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430803.682971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.682990:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430803.682996:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856150272:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430803.683048:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856149888 00000100:00100000:1.0:1787430803.683056:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856149888 00000100:00100000:1.0:1787430803.683103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787430803.683112:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856149888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683162:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856149888:12345-0@lo:400:kworker.0 Request processed in 52us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430803.683171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787430803.683204:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150400 00000100:00100000:1.0:1787430803.683208:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150400 00000100:00100000:1.0:1787430803.683241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150016 00000100:00100000:1.0:1787430803.683244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150016 00000100:00100000:1.0:1787430803.683259:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150144 00000100:00100000:1.0:1787430803.683261:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150144 00000100:00100000:1.0:1787430803.683276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787430803.683281:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856150400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683314:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856150400:12345-0@lo:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430803.683319:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787430803.683355:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787430803.683361:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683400:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856150016:12345-0@lo:400:kworker.0 Request processed in 39us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430803.683406:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787430803.683418:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787430803.683424:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856150144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856150144:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430803.683459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787430803.683476:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150656 00000100:00100000:1.0:1787430803.683480:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150656 00000100:00100000:1.0:1787430803.683507:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430803.683513:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856150656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430803.683541:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430803.683573:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856150656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430803.683578:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430803.683616:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec167480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856150016:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683627:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856149888:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683635:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856150400:0@lo:400:kworker.0 00000100:00080000:1.0:1787430803.683661:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430803.683666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430803.683683:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856150144:0@lo:400:kworker.0 00000100:00100000:1.0:1787430803.683690:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787430803.683695:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787430803.683725:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856150656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430803.683840:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150528 00000100:00100000:3.0:1787430803.683844:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150528 00000100:00100000:3.0:1787430803.683878:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150272 00000100:00100000:3.0:1787430803.683882:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150272 00000100:00100000:3.0:1787430803.683901:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430803.683907:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856150528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430803.683946:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856150528:12345-0@lo:400:kworker.0 Request processed in 39us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430803.683952:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787430803.683964:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430803.683970:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430803.683997:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856150272:12345-0@lo:400:kworker.0 Request processed in 28us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430803.684003:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430803.684037:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856150528:0@lo:400:kworker.0 00000100:00100000:3.0:1787430803.684058:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856150272:0@lo:400:kworker.0 00010000:00010000:0.0:1787430804.508684:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430805.534288:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430806.563295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430806.563365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430806.563392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430806.563413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430806.563437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:1.0:1787430806.563723:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430806.563790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468672 00000100:00100000:3.0:1787430806.563800:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468672 00000100:00100000:3.0:1787430806.563872:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469056 00000100:00100000:3.0:1787430806.563876:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469056 00000100:00100000:3.0:1787430806.563901:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:3.0:1787430806.563912:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2374:x1874256841468672:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430806.563986:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2374:x1874256841468672:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 76us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.563994:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:3.0:1787430806.564012:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:3.0:1787430806.564020:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841469056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430806.564058:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841469056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.564064:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:3.0:1787430806.564084:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468928 00000100:00100000:3.0:1787430806.564087:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468928 00000100:00100000:3.0:1787430806.564112:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468800 00000100:00100000:3.0:1787430806.564115:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468800 00000100:00100000:3.0:1787430806.564133:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:3.0:1787430806.564139:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841468928:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430806.564165:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841468928:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.564172:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:3.0:1787430806.564184:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:3.0:1787430806.564189:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841468800:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430806.564229:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841468800:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430806.564236:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00080000:1.0:1787430806.569881:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787430806.569894:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430806.569898:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430806.574201:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841468544 00000100:00100000:0.0:1787430806.574221:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841468544 00000100:00100000:0.0:1787430806.574291:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 273 00000100:00100000:0.0:1787430806.574302:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841468544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430806.574404:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841468544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 103us (11010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430806.574413:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 273 00010000:00010000:0.0:1787430807.581788:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430807.706826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430807.706914:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469184 00000100:00100000:0.0:1787430807.706925:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469184 00000100:00100000:0.0:1787430807.706995:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 134 00000100:00100000:0.0:1787430807.707006:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10220:x1874256841469184:12345-192.168.204.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787430807.707122:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10220:x1874256841469184:12345-192.168.204.60@tcp:60:lhsmtool_posix.0 Request processed in 117us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430807.707130:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 134 00000100:00100000:0.0:1787430807.711227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430807.711353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469440 00000100:00100000:3.0:1787430807.711363:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469440 00000100:00100000:3.0:1787430807.711432:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:3.0:1787430807.711443:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:10220:x1874256841469440:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430807.712319:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:10220:x1874256841469440:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 873us (1096us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787430807.712353:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:0.0:1787430807.774699:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856150784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430807.774777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430807.774852:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150784 00000100:00100000:0.0:1787430807.774859:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150784 00000100:00100000:3.0:1787430807.782043:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430807.782063:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856150784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430807.782104:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430807.782193:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856150784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (7415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430807.782201:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787430807.782228:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430807.782736:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856150784:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1787430807.841280:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787430807.841312:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787430807.842174:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787430807.842187:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787430808.437411:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430808.437718:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469568 00000100:00100000:3.0:1787430808.437730:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469568 00000100:00100000:3.0:1787430808.437804:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 135 00000100:00100000:3.0:1787430808.437827:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:11020:x1874256841469568:12345-192.168.204.60@tcp:101:lsof.0 00010000:00010000:3.0:1787430808.437851:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430808.437882:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14744 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.437953:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.437967:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.437979:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430808.438236:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787430808.438241:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430808.438379:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.438409:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 7 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.438426:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 6 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430808.438434:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:3.0:1787430808.438437:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430808.438447:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147ae00, rc 0) 00000100:00100000:3.0:1787430808.438852:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:11020:x1874256841469568:12345-192.168.204.60@tcp:101:lsof.0 Request processed in 1036us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430808.438860:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 135 00000100:00080000:1.0:1787430808.439695:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430808.604602:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430808.796912:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430808.796937:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c77ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856150912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430808.797036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430808.797384:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856151168:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.797423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430808.797458:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430808.797464:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856151296:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.797723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430808.797760:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151168 00000100:00100000:0.0:1787430808.797768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151168 00000100:00100000:0.0:1787430808.797819:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151296 00000100:00100000:0.0:1787430808.797823:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151296 00000100:00100000:0.0:1787430808.797855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787430808.797865:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856151168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.797922:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856151168:12345-0@lo:400:kworker.0 Request processed in 58us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430808.797929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787430808.797950:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787430808.797957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c66e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856151296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.797984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c66e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856151296:12345-0@lo:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430808.797989:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787430808.798032:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856151296:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.798044:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856151168:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.798074:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856151040:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.798117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430808.798140:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856151552:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.798160:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430808.798177:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430808.798182:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856151424:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.798205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430808.799525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151552 00000100:00100000:3.0:1787430808.799534:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151552 00000100:00100000:3.0:1787430808.799580:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787430808.799588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856151552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430808.799657:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856151552:12345-0@lo:400:kworker.0 Request processed in 70us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430808.799665:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787430808.799686:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151424 00000100:00100000:3.0:1787430808.799689:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151424 00000100:00100000:3.0:1787430808.799712:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430808.799719:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856151424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430808.799749:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856151424:12345-0@lo:400:kworker.0 Request processed in 31us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430808.799756:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787430808.800279:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856150912 00000100:00100000:1.0:1787430808.800284:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856150912 00000100:00100000:1.0:1787430808.800349:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430808.800357:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856150912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430808.800384:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430808.800423:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856150912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (3388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430808.800438:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787430808.800456:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151040 00000100:00100000:1.0:1787430808.800459:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151040 00000100:00100000:1.0:1787430808.800488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00080000:2.0:1787430808.800736:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430808.800754:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430808.800879:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430808.800918:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3310:x1874256856151040:12345-0@lo:400:kworker.0 Request processed in 423us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430808.800925:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787430808.801088:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856151424:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.801098:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856151040:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.801108:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856151552:0@lo:400:kworker.0 00000100:00100000:0.0:1787430808.801124:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c77ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856150912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787430809.628804:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430810.652858:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430810.844883:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430810.844892:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430810.845422:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787430810.845430:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787430811.679395:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430811.679533:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430811.679644:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469824 00000100:00100000:2.0:1787430811.679653:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469824 00000100:00100000:2.0:1787430811.679730:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:2.0:1787430811.679741:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841469824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:1.0:1787430811.679775:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430811.679830:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841469824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430811.679838:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:2.0:1787430811.683881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430811.683929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430811.683957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430811.683993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430811.684122:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470208 00000100:00100000:0.0:1787430811.684132:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470208 00000100:00100000:0.0:1787430811.684202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:0.0:1787430811.684213:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2374:x1874256841470208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430811.684287:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2374:x1874256841470208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430811.684295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:1.0:1787430811.684349:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469696 00000100:00100000:1.0:1787430811.684353:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469696 00000100:00100000:1.0:1787430811.684396:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 275 00000100:00100000:1.0:1787430811.684403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841469696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430811.684433:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841469952 00000100:00100000:0.0:1787430811.684436:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841469952 00000100:00100000:0.0:1787430811.684461:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470080 00000100:00100000:0.0:1787430811.684464:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470080 00000100:00100000:0.0:1787430811.684497:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787430811.684504:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841469952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430811.684545:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841469952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430811.684552:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787430811.684564:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:0.0:1787430811.684580:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841470080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430811.684603:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841470080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430811.684609:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c3466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841469696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 207us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430811.684609:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:1.0:1787430811.684616:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 275 00000100:00080000:2.0:1787430811.684896:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787430811.684901:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430811.684904:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787430812.700649:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430812.897185:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856151680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430812.897255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430812.901019:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151680 00000100:00100000:3.0:1787430812.901035:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151680 00000100:00100000:3.0:1787430812.901098:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787430812.901110:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856151680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430812.901147:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430812.901229:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856151680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430812.901236:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787430812.901261:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430812.901306:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856151680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787430813.724597:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430813.916932:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430813.916955:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c77aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856151808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430813.917038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430813.917110:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151808 00000100:00100000:1.0:1787430813.917118:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151808 00000100:00100000:1.0:1787430813.917177:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787430813.917188:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856151808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430813.917225:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430813.917269:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856151808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430813.917276:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787430813.917295:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430813.917350:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c77aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856151808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430813.919618:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856151936:0@lo:400:kworker.0 00000100:00100000:2.0:1787430813.919648:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856152320:0@lo:400:kworker.0 00000100:00100000:1.0:1787430813.919738:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856152192:0@lo:400:kworker.0 00000100:00100000:0.0:1787430813.919802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856152064:0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.924270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430813.924386:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856152448:0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.924751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430813.924992:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152448 00000100:00100000:3.0:1787430813.925001:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152448 00000100:00100000:3.0:1787430813.925066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787430813.925077:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856152448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.925143:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856152448:12345-0@lo:400:kworker.0 Request processed in 68us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430813.925149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787430813.925171:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430813.925201:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856152448:0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.925246:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856151936 00000100:00100000:3.0:1787430813.925249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856151936 00000100:00100000:3.0:1787430813.925276:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787430813.925283:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856151936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.925320:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856151936:12345-0@lo:400:kworker.0 Request processed in 38us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430813.925348:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787430813.925380:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856151936:0@lo:400:kworker.0 00000100:00100000:2.0:1787430813.934965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430813.935025:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152320 00000100:00100000:3.0:1787430813.935036:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152320 00000100:00100000:3.0:1787430813.935100:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787430813.935110:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856152320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.935184:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856152320:12345-0@lo:400:kworker.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430813.935191:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787430813.936138:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856152320:0@lo:400:kworker.0 00000100:00100000:1.0:1787430813.937307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430813.937579:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152192 00000100:00100000:3.0:1787430813.937587:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152192 00000100:00100000:3.0:1787430813.937657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787430813.937666:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856152192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.937732:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856152192:12345-0@lo:400:kworker.0 Request processed in 68us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430813.937740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787430813.937952:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430813.937991:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856152192:0@lo:400:kworker.0 00000100:00100000:0.0:1787430813.941544:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430813.945366:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152064 00000100:00100000:3.0:1787430813.945383:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152064 00000100:00100000:3.0:1787430813.945670:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787430813.945683:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856152064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430813.946632:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856152064:12345-0@lo:400:kworker.0 Request processed in 949us (5102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430813.946641:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787430813.946816:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856152064:0@lo:400:kworker.0 00010000:00010000:3.0:1787430814.752597:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430815.120102:0:12316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:33:32 (1787430812) 00010000:00010000:1.0:1787430815.772620:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430816.797604:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430816.820824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430816.821395:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470336 00000100:00100000:1.0:1787430816.821406:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470336 00000100:00100000:1.0:1787430816.821680:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 277 00000100:00100000:1.0:1787430816.821692:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841470336:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430816.821779:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841470336:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 90us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430816.821787:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 277 00000100:00100000:0.0:1787430816.839146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430816.840604:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470464 00000100:00100000:3.0:1787430816.840618:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470464 00000100:00100000:3.0:1787430816.841996:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:3.0:1787430816.842013:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841470464:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430816.842106:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841470464:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 98us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430816.842114:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00080000:1.0:1787430816.861174:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430816.868298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430816.868501:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470592 00000100:00100000:3.0:1787430816.868512:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470592 00000100:00100000:3.0:1787430816.868592:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:3.0:1787430816.868603:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2370:x1874256841470592:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:3.0:1787430816.868633:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e69095 00000100:00080000:3.0:1787430816.868667:0:6686:0:(import.c:65:import_set_state_nolock()) ffffa0f2d8617800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787430816.868710:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967304 00000100:00080000:1.0:1787430816.868907:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430816.869019:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+2:2370:x1874256841470592:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 417us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430816.869028:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00010000:00010000:3.0:1787430816.869051:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430816.870595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430816.870638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430816.870941:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470848 00000100:00100000:2.0:1787430816.870951:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470848 00000100:00100000:2.0:1787430816.871034:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:2.0:1787430816.871045:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2371:x1874256841470848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430816.871128:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2371:x1874256841470848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430816.871136:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:3.0:1787430816.871934:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841470720 00000100:00100000:3.0:1787430816.871941:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841470720 00000100:00100000:3.0:1787430816.871988:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:3.0:1787430816.871998:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2371:x1874256841470720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430816.872049:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2371:x1874256841470720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 53us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430816.872057:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00080000:1.0:1787430816.872131:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430816.872137:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430817.270980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430817.271161:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841471104 00000100:00100000:3.0:1787430817.271172:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841471104 00000100:00100000:3.0:1787430817.271242:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 136 00000100:00100000:3.0:1787430817.271264:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:11285:x1874256841471104:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430817.271286:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430817.271307:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1474b expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.271714:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.271731:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.271742:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.271773:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.271782:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.271789:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272198:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272208:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272214:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430817.272224:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787430817.272818:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272827:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272833:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272838:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430817.272843:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272860:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272873:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0f2d2bc4e00) 00010000:00010000:3.0:1787430817.272876:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430817.272881:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272886:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e696b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272899:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272905:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272911:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272917:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430817.272920:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272926:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272934:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0f2daf05200) 00010000:00010000:3.0:1787430817.272936:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430817.272940:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.272955:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.276132:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1474b expref: 16 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.276158:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1474b expref: 15 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430817.276168:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:3.0:1787430817.276171:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430817.276175:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430817.276771:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:11285:x1874256841471104:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 5507us (5799us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787430817.276781:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 136 00000100:00100000:0.0:1787430817.284896:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430817.284942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841471232 00000100:00100000:3.0:1787430817.284953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841471232 00000100:00100000:3.0:1787430817.285020:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:3.0:1787430817.285071:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:11285:x1874256841471232:12345-192.168.204.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787430817.285198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:11285:x1874256841471232:12345-192.168.204.60@tcp:59:lhsmtool_posix.0 Request processed in 168us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430817.285206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:2.0:1787430817.295272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430817.295416:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841471360 00000100:00100000:0.0:1787430817.295426:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841471360 00000100:00100000:0.0:1787430817.295507:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787430817.295519:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:2373:x1874256841471360:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430817.295535:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430817.295562:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1474b expref: 15 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430817.295597:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:0.0:1787430817.295602:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430817.295673:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:2373:x1874256841471360:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 155us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430817.295680:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00010000:00010000:1.0:1787430817.820588:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430818.013568:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430818.013577:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430818.014124:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787430818.014133:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430818.015533:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430818.015557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c77aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856152576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430818.015626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430818.015693:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152576 00000100:00100000:1.0:1787430818.015700:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152576 00000100:00100000:1.0:1787430818.015757:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787430818.015767:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856152576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430818.015803:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430818.015846:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856152576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430818.015854:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787430818.015876:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430818.016125:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c77aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856152576:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787430818.072352:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00100000:3.0:1787430818.075597:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:3.0:1787430818.075604:0:6708:0:(genops.c:885:class_export_put()) final put ffffa0f2d8611000/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:2.0:1787430818.077533:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2d8611000/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-OST0000 00000020:00000080:2.0:1787430818.080245:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2d8617800 for lustre-OST0000 00010000:00010000:0.0:1787430818.845197:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430819.036612:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c77aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430819.036693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430819.036957:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152704 00000100:00100000:1.0:1787430819.036981:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152704 00000100:00100000:1.0:1787430819.037049:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787430819.037055:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430819.037059:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856152704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430819.037093:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430819.037147:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856152704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430819.037155:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430819.037217:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c77aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430819.041238:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856152960:0@lo:400:kworker.0 00000100:00100000:0.0:1787430819.041242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856152832:0@lo:400:kworker.0 00000100:00100000:2.0:1787430819.047197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feafb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856153216:0@lo:400:kworker.0 00000100:00100000:3.0:1787430819.047416:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856153088:0@lo:400:kworker.0 00000100:00100000:3.0:1787430819.047489:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430819.047566:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856153088 00000100:00100000:3.0:1787430819.047573:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856153088 00000100:00100000:3.0:1787430819.047655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787430819.047667:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856153088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430819.047724:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856153088:12345-0@lo:400:kworker.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430819.047732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787430819.047776:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856153088:0@lo:400:kworker.0 00000100:00080000:3.0:1787430819.047798:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430819.047822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430819.048971:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152960 00000100:00100000:3.0:1787430819.048979:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152960 00000100:00100000:3.0:1787430819.049018:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787430819.049026:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856152960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430819.049071:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856152960:12345-0@lo:400:kworker.0 Request processed in 45us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430819.049077:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787430819.049114:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856152960:0@lo:400:kworker.0 00000100:00100000:0.0:1787430819.052948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430819.053022:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feafbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856153344:0@lo:400:kworker.0 00000100:00100000:0.0:1787430819.053063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430819.053112:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856153344 00000100:00100000:0.0:1787430819.053119:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856153344 00000100:00100000:0.0:1787430819.053189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787430819.053197:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430819.053258:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856153344:12345-0@lo:400:kworker.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430819.053265:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787430819.053286:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430819.053322:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feafbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856153344:0@lo:400:kworker.0 00000100:00100000:1.0:1787430819.055141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856152832 00000100:00100000:1.0:1787430819.055154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856152832 00000100:00100000:1.0:1787430819.055209:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787430819.055228:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856152832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430819.055313:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856152832:12345-0@lo:400:kworker.0 Request processed in 96us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430819.055321:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787430819.056909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856152832:0@lo:400:kworker.0 00000100:00100000:0.0:1787430819.057899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430819.057996:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856153216 00000100:00100000:1.0:1787430819.058003:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856153216 00000100:00100000:1.0:1787430819.058053:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787430819.058063:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856153216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430819.058121:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856153216:12345-0@lo:400:kworker.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430819.058135:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787430819.059395:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feafb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856153216:0@lo:400:kworker.0 00010000:00010000:2.0:1787430819.871622:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430820.061796:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430820.061806:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430820.062389:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787430820.062398:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430820.090971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.091142:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841471488 00000100:00100000:3.0:1787430820.091152:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841471488 00000100:00100000:3.0:1787430820.091239:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:3.0:1787430820.091249:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:11328:x1874256841471488:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430820.091269:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430820.091291:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14752 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787430820.091499:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787430820.091633:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.091648:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.091659:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.091674:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.091681:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.091687:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092000:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092008:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092015:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092031:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430820.092036:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092045:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092059:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:3.0:1787430820.092062:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430820.092067:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092073:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e696d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092087:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092092:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092098:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092103:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430820.092105:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092111:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092130:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430820.092132:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430820.092135:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092141:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e696df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092178:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14752 expref: 14 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092189:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:3.0:1787430820.092191:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430820.092195:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e696d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14752 expref: 14 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.092205:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430820.092280:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:11328:x1874256841471488:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1031us (1314us total) trans 0 rc 301/301 00000100:00100000:3.0:1787430820.092288:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:3.0:1787430820.101701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.101919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841471744 00000100:00100000:0.0:1787430820.101940:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841471744 00000100:00100000:0.0:1787430820.102010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 139 00000100:00100000:0.0:1787430820.102021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:11328:x1874256841471744:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:0.0:1787430820.102083:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430820.102111:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6904f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1458b expref: 13 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.102136:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:0.0:1787430820.102141:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430820.102575:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.102590:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 5 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.102598:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.102631:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 5 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.102646:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 5 pid: 9043 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.102660:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856153472:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430820.102746:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430820.110959:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856153472:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430820.110991:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.116160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430820.116574:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841471872 00000100:00100000:1.0:1787430820.116607:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841471872 00010000:00010000:1.0:1787430820.116667:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 6 pid: 9043 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430820.116713:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:1.0:1787430820.116724:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2374:x1874256841471872:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430820.116738:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430820.116746:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 6 pid: 9043 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.116759:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 6 pid: 9043 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.116781:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e696a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14744 expref: 6 pid: 9043 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.116796:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:1.0:1787430820.116801:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.116810:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.116818:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.116844:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430820.116895:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841471872:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 172us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430820.116911:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00080000:0.0:1787430820.117089:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787430820.117538:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.117550:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.117574:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.117594:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.117603:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430820.119858:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787430820.119877:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.119888:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.119896:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.119902:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430820.119907:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.119915:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.119930:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4900) 00010000:00010000:0.0:1787430820.119951:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430820.119957:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.119963:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430820.119983:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7135e0d reply state 00000000c3e99f9c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.119992:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430820.120096:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:11328:x1874256841471744:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 18073us (18401us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787430820.120106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 139 00010000:00010000:1.0:1787430820.125396:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.125424:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.125432:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.125437:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430820.125441:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.125449:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.125468:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0f2d2bc4b00) 00010000:00010000:1.0:1787430820.125471:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430820.125475:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.125481:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e696ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430820.296799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.297261:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472000 00000100:00100000:0.0:1787430820.297272:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472000 00000100:00100000:0.0:1787430820.297359:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 140 00000100:00100000:0.0:1787430820.297371:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:11336:x1874256841472000:12345-192.168.204.60@tcp:101:lctl.0 00010000:00010000:0.0:1787430820.297396:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430820.297430:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14759 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.297577:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e696fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.297591:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e696fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.297603:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e696fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430820.297680:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787430820.297684:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430820.297705:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e696fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.297731:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e696f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14759 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.297911:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e696fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14759 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.297921:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:0.0:1787430820.297925:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430820.297928:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263e00, rc 0) 00000100:00100000:0.0:1787430820.298240:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:11336:x1874256841472000:12345-192.168.204.60@tcp:101:lctl.0 Request processed in 870us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430820.298248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 140 00000100:00100000:3.0:1787430820.451877:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430820.452011:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472128 00000100:00100000:1.0:1787430820.452022:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472128 00000100:00100000:1.0:1787430820.452086:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 141 00000100:00100000:1.0:1787430820.452096:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:11342:x1874256841472128:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430820.452116:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430820.452151:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14760 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452223:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452237:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452251:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452265:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452273:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452279:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452440:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452449:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452457:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430820.452490:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787430820.452494:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430820.452529:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452548:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452556:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452564:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452570:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430820.452575:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452593:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452606:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:1.0:1787430820.452608:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430820.452613:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452619:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452635:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452641:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452647:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452659:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430820.452662:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452668:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452676:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0f2d0ce5300) 00010000:00010000:1.0:1787430820.452678:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430820.452680:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452686:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452716:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14760 expref: 16 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452729:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14760 expref: 15 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.452736:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430820.452738:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430820.452741:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5000, rc 0) 00000100:00100000:1.0:1787430820.452874:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:11342:x1874256841472128:12345-192.168.204.60@tcp:101:bash.0 Request processed in 779us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430820.452882:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 141 00000100:00100000:1.0:1787430820.462784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.464819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472384 00000100:00100000:0.0:1787430820.464832:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472384 00000100:00100000:0.0:1787430820.464913:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 142 00000100:00100000:0.0:1787430820.464924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:11342:x1874256841472384:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430820.464944:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430820.464966:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6971e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14767 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.465117:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.465147:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.465159:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.465212:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.465220:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.465228:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787430820.466084:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787430820.466254:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466265:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466288:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466363:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466371:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466377:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466390:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430820.466394:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466411:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466423:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:0.0:1787430820.466426:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430820.466431:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.466437:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69725 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430820.466453:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5503d15 reply state 0000000002c766cc transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.466462:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787430820.466495:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6971e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.467133:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.467141:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430820.467143:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430820.467146:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430820.467274:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11342:x1874256841472384:12345-192.168.204.60@tcp:101:bash.0 Request processed in 2342us (4490us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787430820.467291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 142 00010000:00010000:1.0:1787430820.475200:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.475218:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.475226:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.475231:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430820.475236:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.475244:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.475261:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d2bc4900) 00010000:00010000:1.0:1787430820.475263:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787430820.478206:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.478675:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472512 00000100:00100000:0.0:1787430820.478686:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472512 00000100:00100000:0.0:1787430820.478728:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:0.0:1787430820.478737:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1874256841472512:12345-192.168.204.60@tcp:8:bash.0 00010000:00080000:0.0:1787430820.478772:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:0.0:1787430820.478808:0:6685:0:(genops.c:1385:class_connect()) connect: client 711a801a-27eb-4d09-8ae0-8dc5ece71a10, cookie 0x1fa5b1e070e69741 00002000:00100000:0.0:1787430820.478821:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 711a801a-27eb-4d09-8ae0-8dc5ece71a10/ffffa0f2c992f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787430820.478844:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787430820.479120:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787430820.479151:0:6685:0:(import.c:65:import_set_state_nolock()) ffffa0f2c992a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430820.479216:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2370:x1874256841472512:12345-192.168.204.60@tcp:8:bash.0 Request processed in 478us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430820.479224:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00010000:00010000:1.0:1787430820.483376:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.483393:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e6972c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430820.488220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430820.488304:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472640 00000100:00100000:1.0:1787430820.488314:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472640 00000100:00100000:1.0:1787430820.488438:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:1.0:1787430820.488449:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:0:x1874256841472640:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430820.488469:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430820.488488:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1476e expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430820.488546:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430820.488566:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=284s v=(0 0) 00010000:00010000:1.0:1787430820.488570:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430820.488580:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787430820.488675:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787430820.488856:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.488872:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5200, rc 0) 00000100:00100000:1.0:1787430820.488935:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:0:x1874256841472640:12345-192.168.204.60@tcp:101:bash.0 Request processed in 487us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430820.488942:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:3.0:1787430820.494188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.494302:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472768 00000100:00100000:0.0:1787430820.494311:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472768 00000100:00100000:0.0:1787430820.494416:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:0.0:1787430820.494427:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feafbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:11342:x1874256841472768:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430820.494445:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430820.494464:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14775 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.494498:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.494740:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430820.494745:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430820.494752:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.494786:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.494800:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.494814:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6685:1874256856153600:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430820.494947:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430820.510088:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6685:1874256856153600:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430820.510134:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.510178:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262c00, rc 0) 00000100:00100000:3.0:1787430820.510243:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feafbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:11342:x1874256841472768:12345-192.168.204.60@tcp:101:bash.0 Request processed in 15816us (16064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430820.510252:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787430820.526108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.526204:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841472896 00000100:00100000:0.0:1787430820.526214:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841472896 00010000:00010000:0.0:1787430820.526262:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.526318:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:0.0:1787430820.526721:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841472896:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430820.526739:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430820.526765:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.526799:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.526824:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1476e expref: 8 pid: 6686 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.526841:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430820.526846:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430820.526854:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.526864:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.526903:0:11667:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430820.526918:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11667:1874256856153728:192.168.204.60@tcp:105: 00000100:00100000:0.0:1787430820.527047:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430820.535898:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11667:1874256856153728:192.168.204.60@tcp:105: 00010000:00010000:3.0:1787430820.535939:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430820.536001:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841472896:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 9674us (9904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430820.536013:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:2.0:1787430820.546928:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.547053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841473152 00000100:00100000:3.0:1787430820.547066:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841473152 00000100:00100000:3.0:1787430820.547135:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:3.0:1787430820.547147:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:11342:x1874256841473152:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:3.0:1787430820.547930:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11342:x1874256841473152:12345-192.168.204.60@tcp:35:bash.0 Request processed in 784us (1010us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787430820.547939:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:2.0:1787430820.709527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.709711:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841473408 00000100:00100000:3.0:1787430820.709720:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841473408 00000100:00100000:3.0:1787430820.709786:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 143 00000100:00100000:3.0:1787430820.709795:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11352:x1874256841473408:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430820.709818:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430820.709836:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1477c expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430820.710061:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787430820.710187:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69756 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1477c expref: 20 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.710202:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:3.0:1787430820.710206:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430820.710210:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1477c expref: 20 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.710224:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430820.710460:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11352:x1874256841473408:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 664us (940us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787430820.710467:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 143 00000100:00100000:1.0:1787430820.718090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.718508:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841473664 00000100:00100000:3.0:1787430820.718936:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841473664 00000100:00100000:3.0:1787430820.718994:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:3.0:1787430820.719005:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11352:x1874256841473664:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430820.721071:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11352:x1874256841473664:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 2059us (2983us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787430820.721082:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00010000:00010000:1.0:1787430820.892489:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430820.932299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.933669:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841473792 00000100:00100000:3.0:1787430820.933683:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841473792 00000100:00100000:3.0:1787430820.933753:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 144 00000100:00100000:3.0:1787430820.933763:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11358:x1874256841473792:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430820.933791:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430820.933825:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14783 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.933901:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6976b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.933914:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6976b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.933926:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6976b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430820.933988:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787430820.933992:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430820.934015:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6976b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.934042:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14783 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.934060:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6976b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14783 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.934069:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430820.934072:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430820.934075:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430820.934188:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:11358:x1874256841473792:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 425us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430820.934194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 144 00000100:00100000:2.0:1787430820.943443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.944161:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841474048 00000100:00100000:0.0:1787430820.944172:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841474048 00000100:00100000:0.0:1787430820.944249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 145 00000100:00100000:0.0:1787430820.944260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:11358:x1874256841474048:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430820.944294:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430820.944645:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69772 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1478a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.944765:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.944780:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.944792:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430820.944804:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787430820.944942:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69772 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1478a expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.944964:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1478a expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.944973:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430820.944976:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430820.944979:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262200, rc 0) 00000100:00100000:0.0:1787430820.945042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:11358:x1874256841474048:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 784us (1609us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787430820.945050:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 145 00000100:00100000:1.0:1787430820.953242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.953366:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841474176 00000100:00100000:3.0:1787430820.953398:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841474176 00000100:00100000:3.0:1787430820.953467:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:3.0:1787430820.953479:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:2373:x1874256841474176:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430820.953497:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430820.953524:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1478a expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.953547:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:3.0:1787430820.953552:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430820.953622:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:2373:x1874256841474176:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 146us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430820.953629:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:1.0:1787430820.964095:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430820.964172:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841474432 00000100:00100000:3.0:1787430820.964193:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841474432 00000100:00100000:3.0:1787430820.964252:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 146 00000100:00100000:3.0:1787430820.964263:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11358:x1874256841474432:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430820.964288:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430820.964309:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14791 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.964458:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6978e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.964474:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6978e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.964484:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6978e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430820.964531:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787430820.964951:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14791 expref: 25 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.964971:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6978e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14791 expref: 24 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430820.964979:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:3.0:1787430820.964982:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787430820.964986:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430820.965054:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11358:x1874256841474432:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 792us (970us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787430820.965061:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 146 00000100:00100000:2.0:1787430820.979126:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430820.979227:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841474560 00000100:00100000:1.0:1787430820.979237:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841474560 00000100:00100000:1.0:1787430820.979288:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:1.0:1787430820.979298:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841474560:12345-192.168.204.60@tcp:1:lfs.0 00010000:00010000:1.0:1787430820.980808:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.980834:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.980857:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430820.980861:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430820.980866:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.980906:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430820.980922:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430820.980938:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c77adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1874256856153856:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430820.981040:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430820.984961:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c77adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6686:1874256856153856:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430820.984994:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430820.985470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430820.985809:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841474688 00000100:00100000:0.0:1787430820.985818:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841474688 00002000:00100000:0.0:1787430820.985868:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0f2fe05a300 x1874256841474688/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:41/0 lens 504/0 e 0 to 0 dl 1787430831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787430820.985891:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe05a300 with x1874256841474688 ext(0->12) 00010000:00010000:0.0:1787430820.985900:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 8 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430820.985915:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 8 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430820.985923:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fe05a300 00000100:00100000:0.0:1787430820.985958:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787430820.985968:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841474688:12345-192.168.204.60@tcp:4:lfs.0 00000001:00100000:3.0:1787430821.086018:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000001:00080000:3.0:1787430821.155149:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1787430821.155405:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841474688:12345-192.168.204.60@tcp:4:lfs.0 Request processed in 169417us (169914us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787430821.155433:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00002000:00100000:2.0:1787430821.155459:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0f2fe05a300 x1874256841474688/t4294967305(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:41/0 lens 504/448 e 0 to 0 dl 1787430831 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430821.155471:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe05a300 with x1874256841474688 ext(0->12) 00010000:00010000:2.0:1787430821.155482:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.155501:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430821.155510:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fe05a300 00000100:00100000:2.0:1787430821.162451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.162528:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841474816 00000100:00100000:3.0:1787430821.162540:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841474816 00010000:00010000:3.0:1787430821.162591:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430821.162640:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:3.0:1787430821.162649:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841474816:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430821.162664:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787430821.162684:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787430821.162687:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787430820 00002000:00010000:3.0:1787430821.162690:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787430820 00002000:00010000:3.0:1787430821.162705:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787430820 00002000:00010000:3.0:1787430821.162707:0:5822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787430821.162714:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.162729:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.162755:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a64fa612/0x1fa5b1e070e6974f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14775 expref: 7 pid: 6685 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.162772:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430821.162776:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787430821.162782:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.162791:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.162834:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430821.162895:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841474816:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 246us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430821.162903:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00010000:00010000:1.0:1787430821.163871:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163885:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163914:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163933:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163941:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163947:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430821.163951:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163960:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163974:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.163981:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e6979c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430821.164058:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841474560:12345-192.168.204.60@tcp:1:lfs.0 Request processed in 184759us (184939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430821.164066:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:2.0:1787430821.167271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.167743:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841475072 00000100:00100000:3.0:1787430821.167755:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841475072 00000100:00100000:3.0:1787430821.167805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:3.0:1787430821.167815:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11358:x1874256841475072:12345-192.168.204.60@tcp:35:lfs.0 00000004:00010000:3.0:1787430821.168023:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6978e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14791 expref: 24 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430821.168407:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787430821.170257:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787430821.173026:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787430821.173113:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.173138:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.173148:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.173189:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.173220:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 28 pid: 5837 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430821.173235:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874256856153984:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430821.173553:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430821.177280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.178156:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841475200 00000100:00100000:3.0:1787430821.178168:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841475200 00010000:00010000:3.0:1787430821.178211:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 29 pid: 5837 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430821.178257:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:3.0:1787430821.178277:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:2374:x1874256841475200:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430821.178293:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430821.178300:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 29 pid: 5837 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.178314:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 29 pid: 5837 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.178440:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:3.0:1787430821.178446:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.178457:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.178463:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.178481:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430821.178546:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:2374:x1874256841475200:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 271us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430821.178554:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00010000:00010000:2.0:1787430821.181816:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14767 expref: 28 pid: 5837 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430821.181853:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874256856153984:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430821.181882:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.181893:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.181900:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430821.182034:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787430821.182242:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787430821.182420:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874256856154112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430821.182486:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.182519:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430821.184121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856154112 00000100:00100000:3.0:1787430821.184133:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856154112 00000100:00100000:3.0:1787430821.184211:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430821.184222:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874256856154112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787430821.184366:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874256856154112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430821.184374:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430821.184434:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874256856154112:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787430821.185004:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787430821.186554:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787430821.190762:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe058a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874256856154240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787430821.191555:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430821.191813:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c785e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787430821.197917:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856154240 00000100:00100000:3.0:1787430821.197933:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856154240 00000100:00100000:3.0:1787430821.198051:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430821.198064:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874256856154240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787430821.198469:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1874256856154240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 407us (6915us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787430821.198478:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430821.199048:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe058a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874256856154240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787430821.199122:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787430821.199170:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.199181:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.199189:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.199195:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430821.199200:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.199208:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.199224:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:2.0:1787430821.199226:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787430821.199230:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430821.199237:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e697a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430821.199523:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787430821.199655:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787430821.199666:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 284754338408ns, next at 285754336629ns, rc = 0 00000001:00080000:2.0:1787430821.199672:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787430821.199705:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:2.0:1787430821.199721:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430821.199729:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6978e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14791 expref: 32 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430821.199999:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:11358:x1874256841475072:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 32183us (32747us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787430821.200008:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000020:00080000:2.0:1787430821.200014:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787430821.211885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.217534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841475328 00000100:00100000:3.0:1787430821.217551:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841475328 00000100:00100000:3.0:1787430821.217783:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 147 00000100:00100000:3.0:1787430821.217794:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:11358:x1874256841475328:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430821.217818:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430821.217853:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e697aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14798 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.217937:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e697aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14798 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.217951:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e697aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14798 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.217970:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430821.217973:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430821.217977:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430821.218046:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11358:x1874256841475328:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 254us (6170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430821.218053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 147 00000100:00100000:0.0:1787430821.227139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.227744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841475584 00000100:00100000:3.0:1787430821.227755:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841475584 00000100:00100000:3.0:1787430821.227813:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:3.0:1787430821.227889:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11358:x1874256841475584:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430821.228207:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:11358:x1874256841475584:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 383us (1076us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787430821.228216:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:1.0:1787430821.406515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430821.406663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841475840 00000100:00100000:0.0:1787430821.406675:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841475840 00000100:00100000:0.0:1787430821.406747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 148 00000100:00100000:0.0:1787430821.406758:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:11368:x1874256841475840:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430821.406784:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430821.406805:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1479f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430821.407146:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787430821.407286:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1479f expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.407318:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:0.0:1787430821.407321:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430821.407444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1479f expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.407461:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430821.407576:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11368:x1874256841475840:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 818us (1070us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787430821.407583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 148 00000100:00100000:0.0:1787430821.416013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430821.416141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841475968 00000100:00100000:1.0:1787430821.416151:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841475968 00000100:00100000:1.0:1787430821.416306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 149 00000100:00100000:1.0:1787430821.416318:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11368:x1874256841475968:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:1.0:1787430821.416655:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416674:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416685:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416701:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416708:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416715:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416977:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416987:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.416995:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430821.417040:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417052:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417066:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417073:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417079:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430821.417083:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417091:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417103:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430821.417106:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430821.417111:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417116:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e697bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417132:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417137:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417142:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417147:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430821.417290:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417300:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417310:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5300) 00010000:00010000:1.0:1787430821.417313:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430821.417316:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417323:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e697c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417514:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417521:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417528:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417534:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430821.417538:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417545:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417554:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430821.417556:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430821.417579:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430821.417586:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e697cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430821.417680:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11368:x1874256841475968:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 1362us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430821.417689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 149 00000100:00100000:2.0:1787430821.420914:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.421058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841476224 00000100:00100000:3.0:1787430821.421069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841476224 00000100:00100000:3.0:1787430821.421124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:3.0:1787430821.421136:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11368:x1874256841476224:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430821.421473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:11368:x1874256841476224:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 339us (567us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787430821.421499:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:2.0:1787430821.508956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.509095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841476480 00000100:00100000:3.0:1787430821.509106:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841476480 00000100:00100000:3.0:1787430821.509189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 150 00000100:00100000:3.0:1787430821.509200:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:11371:x1874256841476480:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430821.509225:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430821.509255:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e697d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.510083:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.510099:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.510112:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.510128:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.510136:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.510143:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.511653:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.511685:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.511694:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430821.511708:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787430821.512665:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512679:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512687:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512693:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430821.512698:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512707:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512723:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430821.512726:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430821.512730:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512737:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e697db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512755:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512772:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512777:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512782:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430821.512786:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512791:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512798:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2daf05200) 00010000:00010000:3.0:1787430821.512801:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430821.512803:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.512808:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e697e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.513309:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e697d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.514017:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430821.514031:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430821.514034:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430821.514049:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216d200, rc 0) 00000100:00100000:3.0:1787430821.514138:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11371:x1874256841476480:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 4937us (5189us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787430821.514148:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 150 00000100:00100000:1.0:1787430821.527718:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430821.527922:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841476608 00000100:00100000:0.0:1787430821.527933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841476608 00000100:00100000:0.0:1787430821.527996:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 151 00000100:00100000:0.0:1787430821.528007:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11371:x1874256841476608:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:0.0:1787430821.531204:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531229:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531243:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531274:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531280:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531303:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531309:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430821.531313:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531322:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531744:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:0.0:1787430821.531749:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430821.531754:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430821.531762:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e697f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430821.539016:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11371:x1874256841476608:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 10998us (11295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430821.539034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 151 00000100:00100000:2.0:1787430821.547059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430821.547143:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841476864 00000100:00100000:3.0:1787430821.547154:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841476864 00000100:00100000:3.0:1787430821.547580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:3.0:1787430821.547591:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11371:x1874256841476864:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430821.547868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:11371:x1874256841476864:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 278us (818us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787430821.547878:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:2.0:1787430821.917690:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430821.917756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430821.917831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841476992 00000100:00100000:1.0:1787430821.917841:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841476992 00000100:00100000:3.0:1787430821.917847:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841477120 00000100:00100000:3.0:1787430821.917851:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841477120 00000100:00100000:3.0:1787430821.917891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 118 00000100:00100000:1.0:1787430821.917898:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 279 00000100:00100000:3.0:1787430821.917901:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:2372:x1874256841477120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430821.917904:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841476992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430821.918445:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2372:x1874256841476992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 539us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430821.918454:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 279 00010000:00010000:0.0:1787430821.918975:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430821.921674:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:2372:x1874256841477120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3761us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430821.921691:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 118 00000100:00100000:1.0:1787430821.955893:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430821.955929:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430821.955962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430821.955996:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841477504 00000100:00100000:1.0:1787430821.956004:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841477504 00000100:00100000:1.0:1787430821.956053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:1.0:1787430821.956063:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841477504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430821.956126:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2373:x1874256841477504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430821.956145:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:0.0:1787430821.956474:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841477248 00000100:00100000:0.0:1787430821.956479:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841477248 00000100:00100000:0.0:1787430821.956518:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841477376 00000100:00100000:0.0:1787430821.956522:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841477376 00000100:00100000:0.0:1787430821.956554:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:0.0:1787430821.956568:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841477248:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430821.956603:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2372:x1874256841477248:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.956609:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:0.0:1787430821.956622:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:0.0:1787430821.956638:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841477376:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430821.956665:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841477376:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430821.956690:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00080000:0.0:1787430821.956711:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430822.082013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430822.082129:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841477760 00000100:00100000:2.0:1787430822.082140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841477760 00000100:00100000:2.0:1787430822.082233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 152 00000100:00100000:2.0:1787430822.082244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:11402:x1874256841477760:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:2.0:1787430822.082264:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430822.082284:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e697fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.082450:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.082465:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.082476:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430822.082507:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787430822.082646:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e697fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147ad expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.082668:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147ad expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.082677:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430822.082680:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430822.082684:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430822.082754:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11402:x1874256841477760:12345-192.168.204.60@tcp:101:cat.0 Request processed in 512us (751us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787430822.082762:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 152 00000100:00080000:0.0:1787430822.083411:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430822.088188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430822.088282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430822.088398:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841478144 00000100:00100000:1.0:1787430822.088408:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841478144 00000100:00100000:1.0:1787430822.088483:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:1.0:1787430822.088493:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:2372:x1874256841478144:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430822.088509:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430822.088535:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147ad expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.088568:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430822.088573:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430822.088634:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:2372:x1874256841478144:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 141us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430822.088641:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:3.0:1787430822.096629:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841478016 00000100:00100000:3.0:1787430822.096644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841478016 00000100:00100000:3.0:1787430822.096745:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787430822.096757:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:11402:x1874256841478016:12345-192.168.204.60@tcp:35:cat.0 00000100:00100000:3.0:1787430822.097047:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11402:x1874256841478016:12345-192.168.204.60@tcp:35:cat.0 Request processed in 291us (8869us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787430822.097056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:0.0:1787430822.223090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430822.223263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841478400 00000100:00100000:3.0:1787430822.223287:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841478400 00000100:00100000:3.0:1787430822.223417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 153 00000100:00100000:3.0:1787430822.223429:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11408:x1874256841478400:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787430822.223456:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430822.223460:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787430822.223490:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6976b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14783 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.223513:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430822.223518:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430822.223532:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69813 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147b4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.223639:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.223654:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.223663:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.223697:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.223712:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 40 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430822.223726:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856154368:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430822.223829:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fefa6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787430822.230805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430822.230912:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841478528 00000100:00100000:2.0:1787430822.230921:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841478528 00010000:00010000:2.0:1787430822.230962:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 41 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430822.231012:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:2.0:1787430822.231023:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+41:2374:x1874256841478528:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430822.231040:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430822.231047:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 41 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.231078:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 41 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.231101:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430822.231107:0:8455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.231116:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.231123:0:8455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.231145:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430822.231212:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+41:2374:x1874256841478528:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 190us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430822.231219:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00010000:00010000:3.0:1787430822.231485:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e697e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147a6 expref: 40 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430822.231505:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856154368:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430822.231523:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.231533:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.231539:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430822.231574:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787430822.231728:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69813 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.231746:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.231754:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430822.231756:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430822.231759:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147ae00, rc 0) 00000100:00100000:3.0:1787430822.231788:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11408:x1874256841478400:12345-192.168.204.60@tcp:101:dd.0 Request processed in 8362us (8709us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787430822.231796:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 153 00000100:00100000:0.0:1787430822.235768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430822.235874:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841478784 00000100:00100000:1.0:1787430822.235883:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841478784 00000100:00100000:1.0:1787430822.235945:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 154 00000100:00100000:1.0:1787430822.235957:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11408:x1874256841478784:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:1.0:1787430822.236712:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.236731:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.236743:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430822.236817:0:6884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787430822.236847:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da1f4560 reply state 00000000ae7a5e67 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430822.236856:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430822.236954:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:11408:x1874256841478784:12345-192.168.204.60@tcp:36:dd.0 Request processed in 997us (1195us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787430822.236962:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 154 00000020:00080000:1.0:1787430822.236967:0:6884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787430822.239623:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.239640:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.239648:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.239654:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430822.239659:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.239682:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.239699:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430822.239702:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430822.239707:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.239713:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430822.698914:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430822.699024:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841478912 00000100:00100000:1.0:1787430822.699035:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841478912 00000100:00100000:1.0:1787430822.699102:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 155 00000100:00100000:1.0:1787430822.699113:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+42:11422:x1874256841478912:12345-192.168.204.60@tcp:101:stat.0 00010000:00010000:1.0:1787430822.699139:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430822.699162:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6982f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147bb expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699241:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699255:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699269:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699283:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699320:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699369:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699478:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699489:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699496:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699530:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.699543:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 43 pid: 5838 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430822.699555:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c77ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856154496:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430822.699671:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430822.704663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430822.704785:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c77ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856154496:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430822.704825:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430822.704948:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841479168 00000100:00100000:3.0:1787430822.704970:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841479168 00000100:00100000:3.0:1787430822.705620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:3.0:1787430822.705632:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+44:5605:x1874256841479168:12345-192.168.204.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787430822.706798:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:5605:x1874256841479168:12345-192.168.204.60@tcp:35:ldlm_bl.0 Request processed in 1162us (2138us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787430822.706937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:0.0:1787430822.709383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430822.709577:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841479296 00000100:00100000:3.0:1787430822.709587:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841479296 00010000:00010000:3.0:1787430822.709628:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 45 pid: 5838 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430822.709675:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787430822.709686:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:2373:x1874256841479296:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430822.709700:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430822.709707:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 45 pid: 5838 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.709721:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 45 pid: 5838 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.709754:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6981a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147b4 expref: 45 pid: 5838 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.709773:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430822.709778:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.709807:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.709823:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.709855:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430822.709917:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+44:2373:x1874256841479296:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 233us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430822.709926:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00010000:00010000:2.0:1787430822.710108:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710116:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430822.710175:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787430822.710180:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430822.710206:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710219:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710238:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710254:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710261:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710267:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430822.710271:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710279:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710289:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430822.710291:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430822.710294:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710299:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710310:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710315:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710321:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710379:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430822.710389:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710395:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710404:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5100) 00010000:00010000:2.0:1787430822.710406:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430822.710409:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710415:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6983d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710457:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e6982f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147bb expref: 44 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710471:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147bb expref: 43 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.710478:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430822.710480:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430822.710483:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5200, rc 0) 00000100:00100000:2.0:1787430822.710511:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:11422:x1874256841478912:12345-192.168.204.60@tcp:101:stat.0 Request processed in 11401us (11606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430822.710518:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 155 00000100:00100000:0.0:1787430822.848563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430822.848682:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841479552 00000100:00100000:3.0:1787430822.848692:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841479552 00000100:00100000:3.0:1787430822.848749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 156 00000100:00100000:3.0:1787430822.848758:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:11428:x1874256841479552:12345-192.168.204.60@tcp:36:truncate.0 00010000:00010000:3.0:1787430822.848820:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430822.848847:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147bb expref: 43 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.848865:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430822.848869:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430822.849113:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.849655:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430822.849669:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430822.850508:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787430822.850631:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c6aa335 reply state 000000005df9cb8c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430822.850642:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430822.850898:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+45:11428:x1874256841479552:12345-192.168.204.60@tcp:36:truncate.0 Request processed in 2138us (2340us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787430822.850907:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 156 00000020:00080000:3.0:1787430822.850913:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787430822.858672:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.858689:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.858715:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.858721:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430822.858725:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.858894:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.858910:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430822.858913:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430822.858918:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430822.858924:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e6984b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430822.944056:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787430823.132570:0:6883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286687240106ns, next at 287687237501ns, rc = 0 00000100:00100000:0.0:1787430823.132810:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430823.132833:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856154624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430823.132903:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430823.133077:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856154624 00000100:00100000:1.0:1787430823.133084:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856154624 00000100:00100000:1.0:1787430823.133162:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430823.133172:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856154624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430823.133205:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430823.133256:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856154624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430823.133263:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430823.133307:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856154624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787430823.136662:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787430823.213816:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967433 is committed 00000004:00080000:3.0:1787430823.213839:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:3.0:1787430823.213862:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:3.0:1787430823.213873:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1787430823.213898:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000020:00080000:3.0:1787430823.213919:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2fefa69c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787430823.213924:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c6117900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2fefa60c0 00000020:00080000:3.0:1787430823.213938:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c6117c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2fde90c00 00000020:00080000:0.0:1787430823.214046:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787430823.214245:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787430823.215198:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430823.215220:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856154752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787430823.215287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430823.216075:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856154752 00000100:00100000:2.0:1787430823.216084:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856154752 00000100:00100000:2.0:1787430823.216141:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787430823.216163:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856154752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787430823.216189:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787430823.216220:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a07a4, atime: 0x6a8a07a4, ctime: 0x6a8a07a4, blocks: 0xb 00010000:00010000:2.0:1787430823.216229:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.216246:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1787430823.216251:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430823.216257:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.216273:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.216285:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.216294:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.216615:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787430823.217165:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856154752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1001us (1874us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787430823.217175:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:0.0:1787430823.217541:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2fe05e680/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787430823.217550:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856154752:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787430823.222783:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430823.222799:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.222815:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430823.222821:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.222862:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.222883:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.222892:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b132e90/0x1fa5b1e070e69852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.223322:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430823.223373:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430823.223376:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430823.232444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430823.232558:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841479680 00000100:00100000:1.0:1787430823.232568:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841479680 00000100:00100000:1.0:1787430823.232632:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 157 00000100:00100000:1.0:1787430823.232644:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+15:11442:x1874256841479680:12345-192.168.204.60@tcp:101:stat.0 00010000:00010000:1.0:1787430823.232671:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430823.232692:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147c2 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.232766:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.232781:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.232792:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.232805:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.232811:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.232817:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233488:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233500:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233517:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430823.233555:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787430823.233560:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430823.233581:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233593:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233602:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233607:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233613:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233619:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430823.233623:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233631:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233643:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430823.233646:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430823.233650:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233668:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69860 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233681:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233686:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233692:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233697:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430823.233700:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233706:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233715:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5400) 00010000:00010000:1.0:1787430823.233717:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430823.233719:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233725:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233760:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 17 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233773:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 16 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.233786:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430823.233788:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430823.233791:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5200, rc 0) 00000100:00100000:1.0:1787430823.233882:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:11442:x1874256841479680:12345-192.168.204.60@tcp:101:stat.0 Request processed in 1227us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430823.233892:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 157 00000100:00100000:0.0:1787430823.364183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430823.364421:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841479936 00000100:00100000:2.0:1787430823.364432:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841479936 00000100:00100000:2.0:1787430823.364509:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 158 00000100:00100000:2.0:1787430823.364546:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+16:11452:x1874256841479936:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430823.364567:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430823.364590:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147c9 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430823.364867:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787430823.365094:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69875 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c9 expref: 18 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.365109:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:2.0:1787430823.365112:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430823.365118:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c9 expref: 18 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.365132:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430823.365205:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:11452:x1874256841479936:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 654us (1022us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787430823.365220:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 158 00000100:00100000:0.0:1787430823.379563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430823.381833:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841480192 00000100:00100000:3.0:1787430823.381847:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841480192 00000100:00100000:3.0:1787430823.382035:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:3.0:1787430823.382052:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:11452:x1874256841480192:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430823.382603:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11452:x1874256841480192:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 556us (3048us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787430823.382611:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:0.0:1787430823.574299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430823.574435:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841480448 00000100:00100000:3.0:1787430823.574446:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841480448 00000100:00100000:3.0:1787430823.574513:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 159 00000100:00100000:3.0:1787430823.574533:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11458:x1874256841480448:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787430823.574563:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430823.574588:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69883 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147d0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.574712:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.574726:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 19 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.574734:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.574764:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 19 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.574776:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 19 pid: 6884 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430823.574789:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856154880:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430823.574893:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430823.593499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430823.593594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841480576 00000100:00100000:1.0:1787430823.593604:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841480576 00010000:00010000:1.0:1787430823.593647:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 20 pid: 6884 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430823.593694:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:1.0:1787430823.593705:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:2374:x1874256841480576:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430823.593720:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430823.593727:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 20 pid: 6884 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.593741:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 20 pid: 6884 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.593768:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430823.593773:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.593781:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.593803:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.593822:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430823.593890:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:2374:x1874256841480576:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 185us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430823.593898:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00010000:00010000:3.0:1787430823.594277:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6986e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147c2 expref: 19 pid: 6884 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430823.594299:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856154880:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430823.594323:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.594459:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.594477:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430823.594498:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787430823.594670:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69883 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.594686:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.594695:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430823.594698:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430823.594700:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430823.594739:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11458:x1874256841480448:12345-192.168.204.60@tcp:101:bash.0 Request processed in 20209us (20450us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787430823.594747:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 159 00000100:00100000:0.0:1787430823.599211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430823.602226:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841480832 00000100:00100000:1.0:1787430823.602242:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841480832 00000100:00100000:1.0:1787430823.602318:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 160 00000100:00100000:1.0:1787430823.602357:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11458:x1874256841480832:12345-192.168.204.60@tcp:36:bash.0 00010000:00010000:1.0:1787430823.602642:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.602658:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.602670:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430823.602722:0:6884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787430823.602749:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025549a35 reply state 0000000074bba7f5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430823.602758:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430823.602852:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11458:x1874256841480832:12345-192.168.204.60@tcp:36:bash.0 Request processed in 525us (3652us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787430823.602859:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 160 00000020:00080000:1.0:1787430823.602864:0:6884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787430823.607627:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.607645:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.607654:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.607661:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430823.607666:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.607688:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.607707:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430823.607710:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430823.607715:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.607721:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69898 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430823.636315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430823.645241:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841480960 00000100:00100000:1.0:1787430823.645256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841480960 00000100:00100000:1.0:1787430823.645378:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 161 00000100:00100000:1.0:1787430823.645390:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:11458:x1874256841480960:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430823.645416:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430823.645438:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6989f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.645920:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.645936:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.645945:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.645992:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.646007:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 22 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430823.646094:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856155008:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430823.646278:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430823.663997:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856155008:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430823.664140:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430823.672688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430823.672841:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841481088 00000100:00100000:3.0:1787430823.672851:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841481088 00010000:00010000:3.0:1787430823.672889:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430823.672927:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:3.0:1787430823.672936:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:2374:x1874256841481088:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430823.672952:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430823.672970:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.672994:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.675696:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6988a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d0 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.675723:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430823.675729:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.675739:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.675747:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.675785:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430823.678033:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.678051:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430823.678113:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787430823.678118:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430823.678143:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.678191:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e6989f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d7 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.678217:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d7 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.678227:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430823.678231:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430823.678234:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4800, rc 0) 00000100:00100000:1.0:1787430823.678323:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11458:x1874256841480960:12345-192.168.204.60@tcp:101:bash.0 Request processed in 32934us (42018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430823.678400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 161 00000100:00100000:3.0:1787430823.678622:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:2374:x1874256841481088:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 5686us (5943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430823.678632:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:0.0:1787430823.684197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430823.687320:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841481344 00000100:00100000:2.0:1787430823.687391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841481344 00000100:00100000:2.0:1787430823.687469:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:2.0:1787430823.687480:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:11458:x1874256841481344:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:2.0:1787430823.687758:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11458:x1874256841481344:12345-192.168.204.60@tcp:35:bash.0 Request processed in 278us (3569us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787430823.687766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:0.0:1787430823.824421:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430823.824564:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841481600 00000100:00100000:3.0:1787430823.824575:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841481600 00000100:00100000:3.0:1787430823.824640:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:3.0:1787430823.824650:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11468:x1874256841481600:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430823.824674:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430823.824694:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e698ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147de expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430823.825004:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787430823.825184:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e698ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147de expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.825198:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:3.0:1787430823.825202:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430823.825207:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e698ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147de expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.825220:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430823.825283:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:11468:x1874256841481600:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 634us (872us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787430823.825291:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:0.0:1787430823.834136:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430823.834648:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841481728 00000100:00100000:2.0:1787430823.834658:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841481728 00000100:00100000:2.0:1787430823.834719:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 163 00000100:00100000:2.0:1787430823.834730:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:11468:x1874256841481728:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:2.0:1787430823.834830:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.834848:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.834877:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.834893:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.834900:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.834906:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835281:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835291:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835298:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430823.835376:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835389:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835395:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835402:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.835416:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430823.835420:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837050:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837078:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430823.837081:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430823.837086:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837092:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e698bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837111:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837117:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837124:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837129:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430823.837132:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837138:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837163:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430823.837165:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430823.837168:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837174:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e698c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837192:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837197:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837203:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837208:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430823.837211:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837217:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837225:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430823.837227:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430823.837230:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.837236:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430823.837712:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:11468:x1874256841481728:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 2980us (3581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430823.837723:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 163 00000100:00100000:0.0:1787430823.843324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430823.843527:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841481984 00000100:00100000:3.0:1787430823.843537:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841481984 00000100:00100000:3.0:1787430823.843698:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:3.0:1787430823.843709:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:11468:x1874256841481984:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430823.846035:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11468:x1874256841481984:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 2318us (2710us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787430823.846047:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:0.0:1787430823.927530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430823.927657:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841482240 00000100:00100000:1.0:1787430823.927668:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841482240 00000100:00100000:1.0:1787430823.927788:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 164 00000100:00100000:1.0:1787430823.927800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11471:x1874256841482240:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430823.927828:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430823.927867:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e698d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.927966:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.927980:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.927991:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928006:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928013:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928020:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928464:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e698e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928478:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e698e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928486:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e698e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430823.928497:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787430823.928595:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928613:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928619:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928626:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430823.928630:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928638:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928651:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430823.928655:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430823.928660:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e698d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928680:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928686:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928692:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928697:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430823.928707:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928713:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928721:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5400) 00010000:00010000:1.0:1787430823.928723:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430823.928725:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928731:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e698de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928774:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e698d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147e5 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928789:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e698e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147e5 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430823.928795:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:1.0:1787430823.928797:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430823.928800:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4a00, rc 0) 00000100:00100000:1.0:1787430823.928866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11471:x1874256841482240:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1068us (1346us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787430823.928874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 164 00000100:00100000:0.0:1787430823.935989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430823.936047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430823.936192:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841482368 00000100:00100000:2.0:1787430823.936274:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841482368 00000100:00100000:2.0:1787430823.936367:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 165 00000100:00100000:2.0:1787430823.936378:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11471:x1874256841482368:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:2.0:1787430823.936450:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936466:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936477:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936504:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936511:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936519:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936524:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430823.936528:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936535:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936562:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430823.936565:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430823.936570:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430823.936577:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e698f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430823.936647:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11471:x1874256841482368:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 270us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430823.936655:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 165 00000100:00100000:3.0:1787430823.936876:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841482496 00000100:00100000:3.0:1787430823.936881:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841482496 00000100:00100000:3.0:1787430823.936919:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787430823.936926:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:2373:x1874256841482496:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430823.936936:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430823.937146:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e698e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147e5 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430823.937161:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:3.0:1787430823.937164:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430823.937190:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+25:2373:x1874256841482496:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 265us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430823.937197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:0.0:1787430823.942401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430823.942491:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841482752 00000100:00100000:2.0:1787430823.942501:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841482752 00000100:00100000:2.0:1787430823.942563:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:2.0:1787430823.942574:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+25:11471:x1874256841482752:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430823.942811:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11471:x1874256841482752:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 239us (419us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787430823.942820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00010000:00010000:0.0:1787430823.964781:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430824.158309:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856155136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430824.158409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430824.158775:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856155136 00000100:00100000:1.0:1787430824.158785:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856155136 00000100:00080000:2.0:1787430824.158859:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430824.158860:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787430824.158870:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856155136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430824.158919:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430824.158979:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856155136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430824.158987:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787430824.159270:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec165880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856155136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430824.163015:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856155520:0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163084:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430824.163132:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430824.163138:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856155392:0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163159:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430824.163181:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856155648:0@lo:400:kworker.0 00000100:00100000:3.0:1787430824.163233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430824.163241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856155520 00000100:00100000:0.0:1787430824.163250:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856155520 00000100:00100000:3.0:1787430824.163274:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787430824.163282:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856155264:0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163307:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856155392 00000100:00100000:0.0:1787430824.163311:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856155392 00000100:00100000:3.0:1787430824.163315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430824.163367:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856155776:0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787430824.163395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430824.163395:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856155520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430824.163438:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856155648 00000100:00100000:3.0:1787430824.163443:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856155648 00000100:00100000:0.0:1787430824.163452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856155520:12345-0@lo:400:kworker.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430824.163461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787430824.163474:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787430824.163479:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856155776 00000100:00100000:0.0:1787430824.163483:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856155776 00000100:00100000:3.0:1787430824.163484:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874256856155648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163508:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787430824.163515:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856155392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856155392:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430824.163568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787430824.163579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787430824.163584:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856155776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430824.163607:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856155776:12345-0@lo:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430824.163612:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1787430824.163630:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430824.163654:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874256856155648:12345-0@lo:400:kworker.0 Request processed in 57us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430824.163660:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856155392:0@lo:400:kworker.0 00000100:00100000:3.0:1787430824.163666:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787430824.163677:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856155520:0@lo:400:kworker.0 00000100:00100000:3.0:1787430824.163706:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856155776:0@lo:400:kworker.0 00000100:00100000:3.0:1787430824.163728:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856155648:0@lo:400:kworker.0 00000100:00100000:2.0:1787430824.164029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856155264 00000100:00100000:2.0:1787430824.164035:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856155264 00000100:00100000:2.0:1787430824.164079:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787430824.164087:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856155264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430824.164136:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856155264:12345-0@lo:400:kworker.0 Request processed in 50us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430824.164143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787430824.164637:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856155264:0@lo:400:kworker.0 00000100:00100000:2.0:1787430824.180811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430824.182176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841483008 00000100:00100000:0.0:1787430824.182188:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841483008 00000100:00100000:0.0:1787430824.182267:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 166 00000100:00100000:0.0:1787430824.182278:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11489:x1874256841483008:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:0.0:1787430824.182300:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430824.182322:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e698fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147ec expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430824.182465:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69901 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430824.182479:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69901 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430824.182490:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69901 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430824.182500:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787430824.182639:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e698fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147ec expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430824.182659:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69901 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147ec expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430824.182667:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:0.0:1787430824.182670:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787430824.182674:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262a00, rc 0) 00000100:00100000:0.0:1787430824.182737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11489:x1874256841483008:12345-192.168.204.60@tcp:101:cat.0 Request processed in 460us (1934us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787430824.182744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 166 00000100:00080000:2.0:1787430824.183468:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430824.224616:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430824.227133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841483136 00000100:00100000:2.0:1787430824.227148:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841483136 00000100:00100000:2.0:1787430824.227224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 167 00000100:00100000:2.0:1787430824.227235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11490:x1874256841483136:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430824.227260:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430824.227280:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6990f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147f3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.227387:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.227401:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.227411:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430824.227599:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787430824.227603:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430824.227675:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.227703:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6990f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147f3 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.227720:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147f3 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.227729:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430824.227740:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430824.227744:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430824.227819:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11490:x1874256841483136:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 585us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430824.227826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 167 00000100:00100000:3.0:1787430824.244139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430824.245008:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841483520 00000100:00100000:2.0:1787430824.245019:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841483520 00000100:00100000:2.0:1787430824.245087:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:2.0:1787430824.245097:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11490:x1874256841483520:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430824.245461:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11490:x1874256841483520:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 364us (1331us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787430824.245469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:0.0:1787430824.249733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430824.249839:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841483648 00000100:00100000:2.0:1787430824.249850:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841483648 00000100:00100000:2.0:1787430824.249947:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:2.0:1787430824.249958:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11490:x1874256841483648:12345-192.168.204.60@tcp:103:lfs.0 00010000:00010000:2.0:1787430824.249975:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787430824.250001:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e698a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147d7 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.250024:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69901 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147ec expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.250038:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e697aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14798 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.250048:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2daf05f00) 00010000:00010000:2.0:1787430824.250072:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430824.250132:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11490:x1874256841483648:12345-192.168.204.60@tcp:103:lfs.0 Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430824.250139:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787430824.253208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430824.253652:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841483776 00000100:00100000:2.0:1787430824.253662:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841483776 00000100:00100000:2.0:1787430824.255221:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 168 00000100:00100000:2.0:1787430824.255241:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11490:x1874256841483776:12345-192.168.204.60@tcp:58:lfs.0 00010000:00010000:2.0:1787430824.255389:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.255406:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430824.255417:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430824.257158:0:9043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787430824.257290:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11490:x1874256841483776:12345-192.168.204.60@tcp:58:lfs.0 Request processed in 2053us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430824.257300:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 168 00000100:00100000:3.0:1787430824.279654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430824.280892:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841483904 00000100:00100000:1.0:1787430824.280905:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841483904 00000100:00100000:1.0:1787430824.281152:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 169 00000100:00100000:1.0:1787430824.281164:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11492:x1874256841483904:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430824.281186:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430824.281217:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69924 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc147fa expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281298:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281314:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281353:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281371:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281379:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281386:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281774:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281786:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281793:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430824.281833:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787430824.281838:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430824.281857:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281869:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281877:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281884:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281890:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281897:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430824.281901:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281909:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281928:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430824.281930:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430824.281934:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281941:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e6992b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281952:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281958:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281964:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281968:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430824.281970:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281977:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281983:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5400) 00010000:00010000:1.0:1787430824.281985:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430824.281988:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.281993:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.282039:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69924 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 29 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.282055:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 28 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430824.282063:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:1.0:1787430824.282065:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430824.282068:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4800, rc 0) 00000100:00100000:1.0:1787430824.282148:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11492:x1874256841483904:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 985us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430824.282157:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 169 00010000:00010000:3.0:1787430824.990982:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430825.026285:0:12468:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430825.026294:0:12468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430825.026456:0:12468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787430825.026465:0:12468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787430825.180551:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430825.180559:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430825.180594:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787430825.180602:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430825.180722:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856155904:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430825.180836:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c785e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787430825.196025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.196129:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856155904:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430825.196398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841484032 00000100:00100000:2.0:1787430825.196405:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841484032 00000100:00100000:2.0:1787430825.196464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 170 00000100:00100000:2.0:1787430825.196474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11505:x1874256841484032:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787430825.196505:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787430825.196634:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11505:x1874256841484032:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 162us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430825.196642:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 170 00000100:00100000:3.0:1787430825.208642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.209778:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841484160 00000100:00100000:1.0:1787430825.209790:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841484160 00000100:00100000:1.0:1787430825.209868:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 171 00000100:00100000:1.0:1787430825.209880:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11505:x1874256841484160:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787430825.209964:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.209981:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.209992:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210453:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210462:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210468:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210508:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210516:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210522:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430825.210561:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787430825.210565:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430825.210578:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210590:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210596:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210603:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210618:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.210623:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210629:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210641:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430825.210643:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430825.210647:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210652:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69940 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210663:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210669:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210675:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210680:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.210683:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210688:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210704:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa0f2d0ce5400) 00010000:00010000:1.0:1787430825.210707:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430825.210709:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210715:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69947 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210742:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210748:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210752:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210757:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.210760:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210765:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210773:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:1.0:1787430825.210775:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430825.210778:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.210783:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6994e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430825.211541:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11505:x1874256841484160:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 Request processed in 1659us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430825.211551:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 171 00000100:00100000:2.0:1787430825.225212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.225492:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841484416 00000100:00100000:1.0:1787430825.225505:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841484416 00000100:00100000:1.0:1787430825.225572:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 172 00000100:00100000:1.0:1787430825.225582:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11505:x1874256841484416:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787430825.225603:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430825.225623:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69955 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14801 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225744:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225760:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225772:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430825.225784:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787430825.225897:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225905:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225912:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225930:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.225934:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.225942:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.226191:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:1.0:1787430825.226195:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430825.226200:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.226207:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e6995c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.226247:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69955 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14801 expref: 30 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.226257:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430825.226259:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787430825.226262:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69955 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14801 expref: 30 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.226271:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4400, rc 0) 00000100:00100000:1.0:1787430825.226367:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11505:x1874256841484416:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 785us (1163us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787430825.226376:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 172 00000100:00100000:2.0:1787430825.242693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.244323:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841484544 00000100:00100000:3.0:1787430825.244352:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841484544 00000100:00100000:3.0:1787430825.244413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 173 00000100:00100000:3.0:1787430825.244423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11505:x1874256841484544:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430825.244463:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430825.244570:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11505:x1874256841484544:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 147us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.244580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 173 00000100:00100000:3.0:1787430825.256288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.257171:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841484800 00000100:00100000:0.0:1787430825.257184:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841484800 00000100:00100000:0.0:1787430825.257243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 174 00000100:00100000:0.0:1787430825.257265:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11505:x1874256841484800:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430825.257287:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430825.257291:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787430825.257354:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147f3 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.257374:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:0.0:1787430825.257380:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430825.257395:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6996a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14808 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787430825.258764:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787430825.259496:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.259691:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.259705:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.259780:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6996a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14808 expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.260408:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14808 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.260418:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2d2bc4f00) 00010000:00010000:0.0:1787430825.260421:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430825.260425:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262600, rc 0) 00000100:00100000:0.0:1787430825.260497:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11505:x1874256841484800:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 3244us (4216us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787430825.260505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 174 00000100:00100000:3.0:1787430825.266164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.269290:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841485056 00000100:00100000:1.0:1787430825.270506:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841485056 00000100:00100000:1.0:1787430825.270575:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 175 00000100:00100000:1.0:1787430825.270586:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11505:x1874256841485056:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430825.270650:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430825.270676:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14808 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.270697:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2d2bc4f00) 00010000:00010000:1.0:1787430825.270708:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430825.270732:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.270747:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.270757:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.270810:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.270955:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.270965:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271924:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271936:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271950:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271956:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.271959:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271967:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271979:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430825.271983:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430825.271986:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.271992:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e6997f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272006:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272012:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272018:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272023:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.272026:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272041:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272290:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x67d34ce8 (ffffa0f2d0ce5400) 00010000:00010000:1.0:1787430825.272293:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430825.272297:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.272312:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69986 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x67d34ce8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430825.272443:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11505:x1874256841485056:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 1856us (6286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430825.272453:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 175 00000100:00100000:2.0:1787430825.277988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.278172:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841485184 00000100:00100000:3.0:1787430825.278193:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841485184 00000100:00100000:3.0:1787430825.278251:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 176 00000100:00100000:3.0:1787430825.278261:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11505:x1874256841485184:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430825.278280:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430825.278312:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6998d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1480f expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.278403:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.278426:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.278437:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.278544:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e6998d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 31 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.278562:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 30 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.278571:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430825.278573:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430825.278577:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b600, rc 0) 00000100:00100000:3.0:1787430825.278633:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11505:x1874256841485184:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 373us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.278641:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 176 00000100:00100000:2.0:1787430825.290014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.290318:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841485440 00000100:00100000:0.0:1787430825.290356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841485440 00000100:00100000:0.0:1787430825.290415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 177 00000100:00100000:0.0:1787430825.290425:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11505:x1874256841485440:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430825.290526:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.290552:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.290565:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787430825.292255:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787430825.292271:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288846943768ns, next at 289846940611ns, rc = 0 00000004:00010000:0.0:1787430825.292484:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf06c578 reply state 00000000fc54ae17 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.292498:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430825.292697:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11505:x1874256841485440:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 2269us (2690us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787430825.292706:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 177 00000100:00100000:2.0:1787430825.304395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:1.0:1787430825.304501:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.304515:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.304523:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.304528:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.304533:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.304541:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.304573:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:1.0:1787430825.304575:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787430825.304580:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.304585:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6999b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.305537:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841485568 00000100:00100000:3.0:1787430825.305550:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841485568 00000100:00100000:3.0:1787430825.305666:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 178 00000100:00100000:3.0:1787430825.305677:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:11505:x1874256841485568:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430825.305700:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430825.305719:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14816 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.305789:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 32 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.305802:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 32 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.305822:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430825.305824:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787430825.305828:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430825.305895:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11505:x1874256841485568:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 220us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.305902:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 178 00000100:00100000:2.0:1787430825.318927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.321829:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841485696 00000100:00100000:0.0:1787430825.321849:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841485696 00000100:00080000:2.0:1787430825.322496:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430825.322570:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:2.0:1787430825.322583:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841485696:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787430825.322962:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841485696:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 381us (4044us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787430825.322971:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:2.0:1787430825.325909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.326001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841485952 00000100:00100000:3.0:1787430825.326010:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841485952 00000100:00100000:3.0:1787430825.326073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:3.0:1787430825.326084:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11505:x1874256841485952:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430825.326318:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:11505:x1874256841485952:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 236us (418us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787430825.326368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:3.0:1787430825.329807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.330010:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841486208 00000100:00100000:1.0:1787430825.330019:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841486208 00000100:00100000:1.0:1787430825.330287:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 179 00000100:00100000:1.0:1787430825.330299:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:11505:x1874256841486208:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787430825.330591:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:11505:x1874256841486208:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 293us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430825.330599:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 179 00000100:00100000:2.0:1787430825.338458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.338924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841486336 00000100:00100000:0.0:1787430825.338934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841486336 00000100:00100000:0.0:1787430825.339005:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 180 00000100:00100000:0.0:1787430825.339016:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+33:11505:x1874256841486336:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430825.339038:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430825.339222:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e699a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1481d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.339370:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e699b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.339385:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e699b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.339404:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e699b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430825.339445:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430825.339466:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e699b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.339493:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e699a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1481d expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.339513:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e699b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1481d expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.339522:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:0.0:1787430825.339525:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787430825.339530:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262000, rc 0) 00000100:00100000:0.0:1787430825.339598:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11505:x1874256841486336:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 584us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430825.339606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 180 00000100:00100000:2.0:1787430825.344560:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.344630:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841486464 00000100:00100000:3.0:1787430825.344640:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841486464 00000100:00100000:3.0:1787430825.344700:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:3.0:1787430825.344710:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841486464:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430825.344730:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430825.344761:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14824 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430825.344789:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a07a8, blocks: 0x1 00010000:00010000:3.0:1787430825.344809:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=288s v=(0 0) 00010000:00010000:3.0:1787430825.344814:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430825.344823:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.344840:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.344853:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430825.345691:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841486464:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 977us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.345701:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:2.0:1787430825.368395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.369150:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841486720 00000100:00100000:3.0:1787430825.369161:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841486720 00000100:00100000:3.0:1787430825.369222:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 181 00000100:00100000:3.0:1787430825.369232:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11505:x1874256841486720:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787430825.369387:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11505:x1874256841486720:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 155us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.369395:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 181 00000100:00100000:2.0:1787430825.404368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.407031:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841486848 00000100:00100000:0.0:1787430825.407046:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841486848 00000100:00100000:0.0:1787430825.407151:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:0.0:1787430825.407163:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:11505:x1874256841486848:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430825.407182:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430825.416163:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1482b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.416238:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.416247:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430825.416251:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430825.416257:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.416306:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.416321:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.416352:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8276a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856156032:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430825.416467:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f4044540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430825.424352:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8276a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856156032:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430825.424393:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.424416:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262200, rc 0) 00000100:00100000:1.0:1787430825.424528:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:11505:x1874256841486848:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 17366us (20198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430825.424537:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:2.0:1787430825.427432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.433221:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841486976 00000100:00100000:0.0:1787430825.433238:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841486976 00010000:00010000:0.0:1787430825.433292:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.436211:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:0.0:1787430825.436233:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2373:x1874256841486976:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430825.436254:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430825.436293:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.436321:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.437155:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e1ab5f/0x1fa5b1e070e699b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14824 expref: 9 pid: 6686 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.437174:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430825.437178:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430825.437186:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.437197:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.437243:0:11667:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.437257:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11667:1874256856156160:192.168.204.60@tcp:105: 00000100:00100000:0.0:1787430825.437837:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f4044480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430825.443149:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11667:1874256856156160:192.168.204.60@tcp:105: 00010000:00010000:0.0:1787430825.443174:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430825.443309:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841486976:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 7076us (15876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430825.443364:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787430825.447819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.447988:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841487104 00000100:00100000:1.0:1787430825.447997:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841487104 00002000:00100000:1.0:1787430825.448057:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0f2fe05ca80 x1874256841487104/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:46/0 lens 504/0 e 0 to 0 dl 1787430836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430825.448080:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe05ca80 with x1874256841487104 ext(0->8) 00002000:00010000:1.0:1787430825.448087:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2fe05ca80 00000100:00100000:1.0:1787430825.448118:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:1.0:1787430825.448128:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841487104:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787430825.449997:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:2374:x1874256841487104:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 Request processed in 1863us (2180us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787430825.450010:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00002000:00100000:1.0:1787430825.450022:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0f2fe05ca80 x1874256841487104/t4294967314(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:46/0 lens 504/448 e 0 to 0 dl 1787430836 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430825.450032:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe05ca80 with x1874256841487104 ext(0->8) 00002000:00010000:1.0:1787430825.450038:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2fe05ca80 00000100:00100000:2.0:1787430825.461622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.461797:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841487232 00000100:00100000:1.0:1787430825.461808:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841487232 00000100:00100000:1.0:1787430825.461871:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 182 00000100:00100000:1.0:1787430825.461882:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11505:x1874256841487232:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787430825.536063:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1787430825.536076:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787430825.536101:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1787430825.536147:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1787430825.536166:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787430825.536175:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787430825.536374:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11505:x1874256841487232:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 Request processed in 74486us (74756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430825.536385:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 182 00000100:00100000:0.0:1787430825.536662:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787430825.536676:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856156288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787430825.536732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430825.536798:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856156288 00000100:00100000:0.0:1787430825.536806:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856156288 00000100:00100000:0.0:1787430825.536842:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787430825.536851:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856156288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787430825.537003:0:8633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787430825.537007:0:8633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787430825 00002000:00010000:0.0:1787430825.537010:0:8633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787430825.537012:0:8633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787430824 -> 1787430825 00002000:00010000:0.0:1787430825.537014:0:8633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787430825.537047:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856156288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (315us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787430825.537053:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:0.0:1787430825.537085:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2d8277480/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787430825.537091:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856156288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787430825.545910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430825.546184:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841487360 00000100:00100000:2.0:1787430825.546195:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841487360 00000100:00100000:2.0:1787430825.546252:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:2.0:1787430825.546264:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:2374:x1874256841487360:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787430825.587062:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:2374:x1874256841487360:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 Request processed in 40791us (41154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430825.587075:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00000001:00080000:0.0:1787430825.587160:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787430825.587171:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787430825.590192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.590454:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841487616 00000100:00100000:1.0:1787430825.590464:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841487616 00000100:00100000:1.0:1787430825.590538:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 183 00000100:00100000:1.0:1787430825.590548:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11505:x1874256841487616:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430825.590603:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430825.590642:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e699b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1481d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.590678:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:1.0:1787430825.590683:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430825.590713:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.590726:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.590748:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430825.591001:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a2c90d9 reply state 00000000262c8cfb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430825.591011:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430825.591193:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11505:x1874256841487616:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 645us (1009us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787430825.591200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 183 00000100:00100000:0.0:1787430825.602661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.603112:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841487744 00000100:00100000:1.0:1787430825.603123:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841487744 00000100:00100000:1.0:1787430825.603188:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:1.0:1787430825.603198:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841487744:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787430825.603483:0:8633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787430825.603499:0:8633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787430825 -> 1787430823 00002000:00010000:1.0:1787430825.603502:0:8633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787430820 00002000:00010000:1.0:1787430825.603505:0:8633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787430825 -> 1787430823 00002000:00010000:1.0:1787430825.603507:0:8633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787430825.603778:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841487744:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 579us (1125us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787430825.603787:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 58 00010000:00010000:2.0:1787430825.604084:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.604095:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.604102:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.604108:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430825.604113:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.604119:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.604135:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:2.0:1787430825.604137:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430825.604142:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.604157:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e699c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.607319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.607551:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488000 00000100:00100000:3.0:1787430825.607562:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488000 00000100:00100000:3.0:1787430825.607771:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 184 00000100:00100000:3.0:1787430825.607783:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:11505:x1874256841488000:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787430825.607859:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.607876:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 18 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.607885:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.607918:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 18 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.607932:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 18 pid: 9043 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.607946:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856156416:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430825.608036:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c531da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430825.611778:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874256856156416:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430825.611807:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.612002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.612440:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488128 00000100:00100000:3.0:1787430825.612448:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488128 00010000:00010000:3.0:1787430825.612491:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 19 pid: 9043 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.612529:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787430825.612539:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:2374:x1874256841488128:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430825.612555:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430825.612562:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 19 pid: 9043 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.612575:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 19 pid: 9043 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.612600:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1480f expref: 19 pid: 9043 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.612867:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430825.612873:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.612883:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.612891:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.612928:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430825.612986:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:2374:x1874256841488128:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 447us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.612993:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00010000:00010000:1.0:1787430825.613097:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613106:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613135:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613142:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613149:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613155:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430825.613159:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613165:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613187:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:1.0:1787430825.613190:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787430825.613194:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.613210:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e699cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430825.613264:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:11505:x1874256841488000:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 Request processed in 5484us (5955us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787430825.613272:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 184 00000100:00100000:3.0:1787430825.616356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430825.616872:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488256 00000100:00100000:0.0:1787430825.616883:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488256 00000100:00100000:0.0:1787430825.616938:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:0.0:1787430825.616964:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841488256:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787430825.617012:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.617033:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.617042:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787430825.617046:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430825.617051:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.617089:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430825.617102:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 8 pid: 6685 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.617116:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fead8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856156544:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430825.617203:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4a6acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430825.622697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430825.622870:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fead8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6685:1874256856156544:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430825.622895:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430825.622973:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488384 00000100:00100000:2.0:1787430825.622982:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488384 00010000:00010000:2.0:1787430825.623017:0:8455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 9 pid: 6685 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430825.623056:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:2.0:1787430825.623065:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841488384:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430825.623079:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430825.623100:0:8455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 9 pid: 6685 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.623112:0:8455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 9 pid: 6685 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.623136:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e699be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1482b expref: 9 pid: 6685 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.623150:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430825.623155:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430825.623161:0:8455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.623171:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.623214:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430825.623273:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841488384:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 209us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430825.623281:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00010000:00010000:1.0:1787430825.623367:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623376:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623400:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623408:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623416:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623423:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430825.623427:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623449:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623461:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430825.623469:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e699d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430825.623525:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841488256:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 Request processed in 6564us (7197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430825.623533:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:0.0:1787430825.626958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430825.627041:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488640 00000100:00100000:2.0:1787430825.627050:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488640 00000100:00100000:2.0:1787430825.627148:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 185 00000100:00100000:2.0:1787430825.627159:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+17:11505:x1874256841488640:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787430825.627244:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627260:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627270:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627499:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627525:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 18 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627533:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627567:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 18 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.627598:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 18 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430825.627612:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856156672:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430825.629827:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430825.633824:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856156672:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430825.633854:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430825.635141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430825.635234:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488768 00000100:00100000:3.0:1787430825.635243:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488768 00010000:00010000:3.0:1787430825.635281:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 19 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.635514:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:3.0:1787430825.635525:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:2374:x1874256841488768:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430825.635539:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430825.635547:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 19 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.635561:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 19 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.635582:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e699a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14816 expref: 19 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.635599:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:3.0:1787430825.635605:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.635613:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.635621:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.635664:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430825.635712:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+18:2374:x1874256841488768:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 189us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430825.635719:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00010000:00010000:2.0:1787430825.635744:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.635752:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430825.636035:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787430825.636192:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787430825.636239:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787430825.636368:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856156800:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787430825.636417:0:9043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430825.636444:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787430825.636539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856156800 00000100:00100000:0.0:1787430825.636546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856156800 00000100:00100000:0.0:1787430825.636587:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430825.636595:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9043:x1874256856156800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787430825.636695:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9043:x1874256856156800:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430825.636701:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787430825.637817:0:9043:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787430825.637824:0:9043:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2d8277480, transno 4294967315 00000100:00100000:2.0:1787430825.637836:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856156800:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1787430825.638353:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787430825.638430:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856156928:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787430825.638491:0:9043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430825.638616:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430825.638709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856156928 00000100:00100000:3.0:1787430825.638716:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856156928 00000100:00100000:3.0:1787430825.638779:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787430825.638789:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c77ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9043:x1874256856156928:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787430825.638971:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c77ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9043:x1874256856156928:12345-0@lo:1000:mdt00_004.0 Request processed in 183us (480us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787430825.638979:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787430825.639049:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856156928:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787430825.639083:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639093:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639100:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639107:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430825.639112:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639119:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639135:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2daf05e00) 00010000:00010000:2.0:1787430825.639138:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430825.639143:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639148:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e699e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639179:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639186:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639199:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639204:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430825.639207:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639213:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639221:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430825.639224:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430825.639227:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639232:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e6991d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639252:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639267:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 21 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639276:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639313:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 21 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.639367:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 21 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430825.639379:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856157056:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430825.639449:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430825.644559:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430825.644745:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856157056:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430825.644774:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.644844:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841488896 00000100:00100000:3.0:1787430825.644851:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841488896 00010000:00010000:3.0:1787430825.644888:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 22 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.644958:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787430825.644968:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:2374:x1874256841488896:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430825.644982:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430825.644994:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 22 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.645007:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 22 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.645029:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc147fa expref: 22 pid: 6884 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.645060:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430825.645065:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.645074:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.645079:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.645101:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430825.645118:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645125:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645136:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645142:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645149:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.645154:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:2374:x1874256841488896:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 188us (607us total) trans 0 rc 0/0 00010000:00010000:2.0:1787430825.645155:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430825.645159:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430825.645161:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00010000:00010000:2.0:1787430825.645228:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645246:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430825.645248:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430825.645252:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645258:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645271:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645277:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645283:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645289:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430825.645291:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645315:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645322:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430825.645325:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430825.645410:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.645416:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430825.645931:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11505:x1874256841488640:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 18773us (18981us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787430825.645940:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 185 00000020:00080000:2.0:1787430825.645944:0:9043:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787430825.647122:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430825.647128:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430825.648185:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787430825.648196:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787430825.648897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430825.648994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841489152 00000100:00100000:2.0:1787430825.649003:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841489152 00000100:00100000:2.0:1787430825.649149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787430825.649160:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11505:x1874256841489152:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787430825.652957:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787430825.653084:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787430825.653169:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.653185:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.653195:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.653202:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.653208:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.653214:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430825.653235:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430825.653630:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430825.653637:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.653644:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430825.653649:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.653656:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.653680:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0f2d22f0c00) 00010000:00010000:3.0:1787430825.653683:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787430825.653688:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.653694:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e699ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430825.653712:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430825.653714:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430825.653716:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430825.656612:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11505:x1874256841489152:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 7441us (7706us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787430825.656628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000020:00080000:2.0:1787430825.656636:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787430826.014285:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787430826.319411:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:1.0:1787430826.915309:0:12522:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787430826.915318:0:12522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430826.915377:0:12522:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787430826.915384:0:12522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430827.027640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.027697:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841489408 00000100:00100000:2.0:1787430827.027707:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841489408 00000100:00100000:2.0:1787430827.027780:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 186 00000100:00100000:2.0:1787430827.027791:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:11522:x1874256841489408:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430827.027826:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.027847:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14832 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.028090:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.028105:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.028118:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430827.028129:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787430827.028298:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e699f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14832 expref: 25 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.028316:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14832 expref: 24 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.028353:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430827.028501:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787430827.028506:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74400, rc 0) 00000100:00100000:2.0:1787430827.028573:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11522:x1874256841489408:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 782us (1131us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787430827.028581:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 186 00000100:00080000:3.0:1787430827.028692:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430827.033759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.033814:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.033844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.033867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.033894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.033923:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841489920 00000100:00100000:3.0:1787430827.033935:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841489920 00000100:00100000:3.0:1787430827.033984:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841489792 00000100:00100000:3.0:1787430827.033987:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841489792 00000100:00100000:3.0:1787430827.034011:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787430827.034026:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841489920:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430827.034103:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841489920:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430827.034114:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787430827.034132:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:3.0:1787430827.034137:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841489792:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430827.034175:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841489792:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430827.034185:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00080000:3.0:1787430827.034203:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787430827.034207:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430827.034318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841489536 00000100:00100000:1.0:1787430827.034322:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841489536 00000100:00100000:1.0:1787430827.034386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841490048 00000100:00100000:1.0:1787430827.034390:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841490048 00000100:00100000:1.0:1787430827.034422:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:1.0:1787430827.034429:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841490048:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430827.034462:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841490048:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430827.034468:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:1.0:1787430827.034488:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 187 00000100:00100000:1.0:1787430827.034494:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11522:x1874256841489536:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:1.0:1787430827.034561:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.034577:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.034588:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.034603:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.034609:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.034616:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035033:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035043:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035053:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430827.035098:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035112:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035128:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035135:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035144:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430827.035148:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035158:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035173:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430827.035176:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430827.035183:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035189:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035203:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035209:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035642:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035648:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430827.035660:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035670:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035679:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5400) 00010000:00010000:1.0:1787430827.035682:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430827.035686:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035691:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035706:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035712:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035718:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035723:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430827.035726:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035732:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035739:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d0ce5800) 00010000:00010000:1.0:1787430827.035741:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430827.035916:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.035923:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69a19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.036493:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841489664 00000100:00100000:2.0:1787430827.036502:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841489664 00000100:00100000:2.0:1787430827.036546:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 281 00000100:00100000:2.0:1787430827.036555:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841489664:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430827.036589:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841489664:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.036597:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 281 00000100:00080000:2.0:1787430827.036629:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430827.037002:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11522:x1874256841489536:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 1488us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430827.037015:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 187 00010000:00010000:3.0:1787430827.037102:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430827.095869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.096581:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841490304 00000100:00100000:2.0:1787430827.096592:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841490304 00000100:00100000:2.0:1787430827.096655:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 188 00000100:00100000:2.0:1787430827.096667:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11525:x1874256841490304:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430827.096688:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.096710:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69a20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14839 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.096789:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.096816:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.096828:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.096857:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.096864:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.096871:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097201:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097211:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097218:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430827.097228:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787430827.097365:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097372:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097379:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097385:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.097390:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097409:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097423:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430827.097426:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.097430:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097436:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097450:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097456:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097462:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097466:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.097469:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097474:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097480:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d22f0900) 00010000:00010000:2.0:1787430827.097482:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.097485:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097499:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097541:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e69a20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097556:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.097563:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.097566:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430827.097569:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430827.097637:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11525:x1874256841490304:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 972us (1776us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787430827.097645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 188 00000100:00100000:1.0:1787430827.109993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.110046:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841490432 00000100:00100000:2.0:1787430827.110056:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841490432 00000100:00100000:2.0:1787430827.110115:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 189 00000100:00100000:2.0:1787430827.110125:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11525:x1874256841490432:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:2.0:1787430827.110193:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110210:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110222:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110263:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110282:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110289:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110295:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.110299:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110307:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110321:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.110346:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430827.110352:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.110359:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.110431:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec166d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11525:x1874256841490432:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 306us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.110439:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 189 00000100:00100000:3.0:1787430827.127827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.128434:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841490688 00000100:00100000:0.0:1787430827.128511:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841490688 00000100:00100000:0.0:1787430827.128575:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:0.0:1787430827.128585:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11525:x1874256841490688:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787430827.128850:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11525:x1874256841490688:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 265us (1032us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787430827.128859:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:0.0:1787430827.156601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430827.156696:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841490944 00000100:00100000:1.0:1787430827.156706:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841490944 00000100:00100000:1.0:1787430827.156769:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 190 00000100:00100000:1.0:1787430827.156779:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11050:x1874256841490944:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430827.156802:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430827.156831:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14840 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.156926:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.156940:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.156948:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.156978:0:6884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.157009:0:6884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 28 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430827.157023:0:6884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec164000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6884:1874256856157184:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430827.157120:0:6884:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c78583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430827.163396:0:6884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec164000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6884:1874256856157184:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430827.163613:0:6884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430827.165559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.167285:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841491072 00000100:00100000:3.0:1787430827.167299:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841491072 00010000:00010000:3.0:1787430827.167370:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 29 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430827.167521:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:1.0:1787430827.167536:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:2374:x1874256841491072:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430827.167552:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430827.167561:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 29 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.167576:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 29 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.167601:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14839 expref: 29 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.167622:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:1.0:1787430827.167627:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.167654:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.167661:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.167698:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430827.167811:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:2374:x1874256841491072:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 278us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430827.167823:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00010000:00010000:3.0:1787430827.167893:0:6884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.167901:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430827.167920:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787430827.168071:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69a4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 29 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.168087:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 28 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.168095:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430827.168098:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430827.168100:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5200, rc 0) 00000100:00100000:3.0:1787430827.168132:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11050:x1874256841490944:12345-192.168.204.60@tcp:101:bash.0 Request processed in 11354us (11541us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787430827.168146:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 190 00000100:00100000:0.0:1787430827.173961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.174081:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841491328 00000100:00100000:2.0:1787430827.174091:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841491328 00000100:00100000:2.0:1787430827.174157:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 191 00000100:00100000:2.0:1787430827.174183:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11050:x1874256841491328:12345-192.168.204.60@tcp:36:bash.0 00010000:00010000:2.0:1787430827.174502:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.174519:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.174532:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430827.174585:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787430827.174611:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a9b029a reply state 000000005e33ce09 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.174633:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787430827.174683:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787430827.174795:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11050:x1874256841491328:12345-192.168.204.60@tcp:36:bash.0 Request processed in 605us (832us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787430827.174804:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 191 00000020:00080000:2.0:1787430827.174810:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787430827.178743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787430827.178853:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.178866:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.178874:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.178881:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.178886:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.178895:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.178914:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430827.178917:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430827.178922:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.178928:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430827.179602:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841491456 00000100:00100000:0.0:1787430827.179614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841491456 00000100:00100000:0.0:1787430827.179675:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 192 00000100:00100000:0.0:1787430827.179688:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:11050:x1874256841491456:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430827.179714:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430827.179734:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69a66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14847 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.179797:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69a66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14847 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.179826:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69a66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14847 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.179846:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:0.0:1787430827.179850:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430827.179853:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262e00, rc 0) 00000100:00100000:0.0:1787430827.179968:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11050:x1874256841491456:12345-192.168.204.60@tcp:101:bash.0 Request processed in 282us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.179975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 192 00000100:00100000:0.0:1787430827.183084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.183247:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841491584 00000100:00100000:3.0:1787430827.183259:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841491584 00000100:00100000:2.0:1787430827.183438:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:2.0:1787430827.184605:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:11050:x1874256841491584:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430827.184626:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.184650:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1484e expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430827.184678:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a07a7, atime: 0x6a8a07a4, ctime: 0x6a8a07a7, blocks: 0xb 00010000:00010000:2.0:1787430827.184700:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1787430827.184704:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430827.184726:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.184745:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.184759:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75400, rc 0) 00000100:00100000:2.0:1787430827.184838:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:11050:x1874256841491584:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1390us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.184845:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:1.0:1787430827.192789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.192907:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841491712 00000100:00100000:2.0:1787430827.192917:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841491712 00002000:00010000:2.0:1787430827.192959:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787430827.192964:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2ec165f80 with x1874256841491712 ext(0->18446744073709551615) 00002000:00010000:2.0:1787430827.192977:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2ec165f80. 00000100:00100000:2.0:1787430827.193007:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787430827.193017:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841491712:12345-192.168.204.60@tcp:10:bash.0 00002000:00010000:2.0:1787430827.193297:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787430827.193301:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787430823 -> 1787430826 00002000:00010000:2.0:1787430827.193304:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787430820 -> 1787430820 00002000:00010000:2.0:1787430827.193306:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787430823 -> 1787430826 00002000:00010000:2.0:1787430827.193308:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787430827.193400:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2373:x1874256841491712:12345-192.168.204.60@tcp:10:bash.0 Request processed in 383us (618us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787430827.193408:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00002000:00010000:2.0:1787430827.193412:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787430827.193429:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2ec165f80 with x1874256841491712 ext(0->18446744073709551615) 00002000:00010000:2.0:1787430827.193433:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2ec165f80. 00000100:00100000:1.0:1787430827.293703:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.293798:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841491840 00000100:00100000:3.0:1787430827.293808:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841491840 00000100:00100000:3.0:1787430827.293871:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 193 00000100:00100000:3.0:1787430827.293882:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11539:x1874256841491840:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:3.0:1787430827.293967:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.293983:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.293994:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294009:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294017:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294023:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294301:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294311:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294318:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430827.294396:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294409:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294428:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294436:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294442:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.294447:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294455:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294468:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430827.294471:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430827.294475:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294482:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294496:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294503:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294510:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294515:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.294522:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294529:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294537:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2daf05a00) 00010000:00010000:3.0:1787430827.294540:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430827.294543:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294549:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294565:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294572:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294578:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294583:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.294586:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294592:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294599:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430827.294601:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430827.294609:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.294616:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430827.294824:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11539:x1874256841491840:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 942us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.294833:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 193 00000100:00100000:0.0:1787430827.343178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.343418:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841492096 00000100:00100000:2.0:1787430827.343429:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841492096 00000100:00100000:2.0:1787430827.343631:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 194 00000100:00100000:2.0:1787430827.343643:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11542:x1874256841492096:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430827.343663:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.343684:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14855 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.343758:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.343772:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.343782:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.343798:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.343805:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.343811:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344114:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344146:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344154:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430827.344164:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787430827.344251:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344259:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344279:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344285:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.344290:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344298:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344309:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430827.344312:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.344316:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344321:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344392:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344403:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344410:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344415:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.344419:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344424:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344432:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d22f0400) 00010000:00010000:2.0:1787430827.344435:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.344438:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344453:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344877:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14855 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344947:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14855 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.344957:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.344959:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787430827.344967:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430827.345031:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11542:x1874256841492096:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1390us (1864us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787430827.345782:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 194 00000100:00100000:1.0:1787430827.348395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.348518:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841492224 00000100:00100000:2.0:1787430827.348529:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841492224 00000100:00100000:2.0:1787430827.348592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 195 00000100:00100000:2.0:1787430827.348603:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11542:x1874256841492224:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:2.0:1787430827.348671:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.348688:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 34 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.348697:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.349064:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 34 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.349081:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 34 pid: 6884 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.349096:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856157312:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430827.349206:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430827.353508:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.353607:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856157312:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430827.353635:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430827.353717:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841492480 00000100:00100000:3.0:1787430827.353724:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841492480 00000100:00100000:3.0:1787430827.353787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:3.0:1787430827.353795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:5604:x1874256841492480:12345-192.168.204.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787430827.354110:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:5604:x1874256841492480:12345-192.168.204.60@tcp:35:ldlm_bl.0 Request processed in 313us (608us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787430827.354118:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:0.0:1787430827.361099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.361230:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841492608 00000100:00100000:3.0:1787430827.361240:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841492608 00010000:00010000:3.0:1787430827.361287:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 36 pid: 6884 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430827.361364:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:3.0:1787430827.361375:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:2373:x1874256841492608:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430827.361391:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430827.361398:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 36 pid: 6884 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.361410:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 36 pid: 6884 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.361431:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69a51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14840 expref: 36 pid: 6884 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.361469:0:11667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430827.361475:0:11667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.361484:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.361675:0:11667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.361710:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430827.361767:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:2373:x1874256841492608:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 394us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430827.361776:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00010000:00010000:2.0:1787430827.361834:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361842:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361873:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361881:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361887:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361892:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.361906:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361915:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361925:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.361927:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430827.361931:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.361937:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.361976:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11542:x1874256841492224:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 13375us (13590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.361990:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 195 00000100:00100000:1.0:1787430827.370964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.371106:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841492864 00000100:00100000:3.0:1787430827.371116:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841492864 00000100:00100000:3.0:1787430827.371181:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:3.0:1787430827.371191:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+34:11542:x1874256841492864:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430827.371464:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:11542:x1874256841492864:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 274us (510us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787430827.371472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:1.0:1787430827.484823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.484926:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841493120 00000100:00100000:0.0:1787430827.484936:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841493120 00000100:00100000:0.0:1787430827.484999:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 196 00000100:00100000:0.0:1787430827.485010:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+35:11553:x1874256841493120:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:0.0:1787430827.485038:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430827.485058:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ab3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1485c expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485131:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485167:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485181:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485197:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485204:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485212:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485665:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485675:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485683:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430827.485693:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787430827.485787:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485795:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485802:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485814:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430827.485818:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485825:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485838:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:0.0:1787430827.485841:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430827.485846:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485852:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69aba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485867:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485873:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485879:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485885:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430827.485888:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485894:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485913:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430827.485915:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430827.485919:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485924:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485967:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1485c expref: 38 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485981:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1485c expref: 37 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.485988:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:0.0:1787430827.485991:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430827.485993:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263600, rc 0) 00000100:00100000:0.0:1787430827.486049:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11553:x1874256841493120:12345-192.168.204.60@tcp:101:cat.0 Request processed in 1041us (1234us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787430827.486058:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 196 00000100:00100000:1.0:1787430827.491659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.491742:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841493376 00000100:00100000:3.0:1787430827.491754:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841493376 00000100:00100000:3.0:1787430827.491811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:3.0:1787430827.491822:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11553:x1874256841493376:12345-192.168.204.60@tcp:35:cat.0 00000100:00100000:3.0:1787430827.492056:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:11553:x1874256841493376:12345-192.168.204.60@tcp:35:cat.0 Request processed in 234us (404us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787430827.492075:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:1.0:1787430827.513205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.513624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841493632 00000100:00100000:2.0:1787430827.513636:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841493632 00000100:00100000:2.0:1787430827.513747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 197 00000100:00100000:2.0:1787430827.513758:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:11554:x1874256841493632:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787430827.513816:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787430827.513842:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1485c expref: 38 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513863:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14855 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513877:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69a66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14847 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513888:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.513898:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430827.513920:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513933:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513942:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513956:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513979:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.513986:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.514317:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.514349:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.514357:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430827.515567:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787430827.515580:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291070252221ns, next at 292070249553ns, rc = 0 00010000:00010000:2.0:1787430827.515643:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.515655:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.515664:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.515672:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.515678:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.515696:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.515722:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430827.516070:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430827.516078:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.516084:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430827.516088:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.516097:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.516115:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0100) 00010000:00010000:1.0:1787430827.516118:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787430827.516122:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.516127:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69aeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430827.516152:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430827.516154:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430827.516156:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430827.516267:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516275:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516281:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516285:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.516288:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516295:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516304:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0f2d22f0100) 00010000:00010000:2.0:1787430827.516306:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787430827.516309:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516315:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69ae4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516361:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516368:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516380:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516385:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.516388:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516393:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516401:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430827.516403:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.516405:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.516412:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69ad6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430827.516421:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000778df918 reply state 0000000016abefff transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.516429:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430827.516580:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+37:11554:x1874256841493632:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2821us (3380us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787430827.516589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 197 00010000:00010000:3.0:1787430827.526081:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.526099:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.526108:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.526114:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.526119:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.526137:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.526156:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d22f0400) 00010000:00010000:3.0:1787430827.526159:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430827.526163:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.526169:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69add lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430827.577570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.577888:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841493888 00000100:00100000:2.0:1787430827.577900:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841493888 00000100:00100000:2.0:1787430827.577964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 198 00000100:00100000:2.0:1787430827.577974:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+36:11560:x1874256841493888:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430827.578014:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.578034:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69af2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14863 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.578171:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.578185:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.578196:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.578210:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.578216:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.578222:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430827.579084:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787430827.579267:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579278:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579287:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579360:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579367:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579374:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579380:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430827.579384:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579391:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579405:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430827.579407:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430827.579411:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.579416:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69af9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430827.579430:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e54485e3 reply state 000000000edfa7b6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.579996:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787430827.580033:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69af2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.580063:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.580070:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.580073:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430827.580075:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430827.580156:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:11560:x1874256841493888:12345-192.168.204.60@tcp:101:bash.0 Request processed in 2184us (2594us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787430827.580165:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 198 00010000:00010000:3.0:1787430827.582142:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.582159:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.582183:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.582190:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.582194:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.582201:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.582217:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d22f0100) 00010000:00010000:3.0:1787430827.582220:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430827.582224:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.582230:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430827.586100:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.586397:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841494016 00000100:00100000:2.0:1787430827.586407:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841494016 00000100:00100000:2.0:1787430827.586471:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:2.0:1787430827.586481:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841494016:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430827.586497:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.586515:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1486a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430827.586539:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787430827.586577:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=291s v=(0 0) 00010000:00010000:2.0:1787430827.586581:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430827.586590:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.586609:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.586633:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74000, rc 0) 00000100:00100000:2.0:1787430827.586693:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2373:x1874256841494016:12345-192.168.204.60@tcp:101:bash.0 Request processed in 214us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.586700:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:0.0:1787430827.592099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.592377:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841494144 00000100:00100000:2.0:1787430827.592387:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841494144 00000100:00100000:2.0:1787430827.592452:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:2.0:1787430827.592463:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:11560:x1874256841494144:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430827.592481:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.592497:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14871 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.592527:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.592536:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430827.592540:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430827.592544:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.592578:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.592591:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.592620:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe05b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874256856157440:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430827.592716:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c95cde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430827.595777:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe05b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874256856157440:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430827.595811:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.595829:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75800, rc 0) 00000100:00100000:2.0:1787430827.595932:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:11560:x1874256841494144:12345-192.168.204.60@tcp:101:bash.0 Request processed in 3470us (3844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.595942:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:0.0:1787430827.602492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.605173:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841494272 00000100:00100000:3.0:1787430827.605190:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841494272 00010000:00010000:3.0:1787430827.605238:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430827.605302:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:3.0:1787430827.605312:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841494272:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430827.605363:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430827.605390:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.605423:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.605562:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1486a expref: 7 pid: 6685 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.605579:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430827.605584:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430827.605592:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.605601:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.605639:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430827.605653:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1874256856157568:192.168.204.60@tcp:105: 00000100:00100000:3.0:1787430827.605737:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c531dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430827.610418:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.612847:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841494528 00000100:00100000:2.0:1787430827.612862:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841494528 00000100:00100000:2.0:1787430827.612925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:2.0:1787430827.612936:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+38:11560:x1874256841494528:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:2.0:1787430827.613280:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:11560:x1874256841494528:12345-192.168.204.60@tcp:35:bash.0 Request processed in 345us (2869us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787430827.613288:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:3.0:1787430827.619154:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1874256856157568:192.168.204.60@tcp:105: 00010000:00010000:3.0:1787430827.619181:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430827.619250:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841494272:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 13939us (16766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430827.619271:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:1.0:1787430827.854794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.854890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841494656 00000100:00100000:3.0:1787430827.854900:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841494656 00000100:00100000:3.0:1787430827.854972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 199 00000100:00100000:3.0:1787430827.854983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+39:11576:x1874256841494656:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430827.855009:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430827.855030:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69b23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14878 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.855096:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69b2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.855110:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.855121:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430827.855191:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787430827.855195:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430827.855218:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.855243:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69b23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14878 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.855270:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14878 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.855278:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430827.855281:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430827.855297:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b600, rc 0) 00000100:00100000:3.0:1787430827.855413:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11576:x1874256841494656:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 431us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430827.855420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 199 00000100:00100000:2.0:1787430827.859713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.859862:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841494912 00000100:00100000:0.0:1787430827.859871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841494912 00000100:00100000:0.0:1787430827.859921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 200 00000100:00100000:0.0:1787430827.859931:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+40:11576:x1874256841494912:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430827.859953:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430827.859991:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69b31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1487f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.860097:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.860112:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.860136:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430827.860149:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787430827.860293:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69b31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1487f expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.860315:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1487f expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.860347:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:0.0:1787430827.860351:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430827.860354:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262000, rc 0) 00000100:00100000:0.0:1787430827.860427:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+42:11576:x1874256841494912:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 497us (724us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787430827.860874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 200 00000100:00100000:1.0:1787430827.868724:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430827.868776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.868863:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841495296 00000100:00100000:0.0:1787430827.868874:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841495296 00000100:00100000:0.0:1787430827.868945:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:0.0:1787430827.868957:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+42:2373:x1874256841495296:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430827.868989:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430827.869017:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262000/0x1fa5b1e070e69b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1487f expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.869040:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:0.0:1787430827.869044:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430827.869099:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+41:2373:x1874256841495296:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 144us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.869106:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:2.0:1787430827.869294:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841495168 00000100:00100000:2.0:1787430827.869299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841495168 00000100:00100000:2.0:1787430827.869357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 201 00000100:00100000:2.0:1787430827.869364:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+41:11576:x1874256841495168:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430827.869384:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430827.869407:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14886 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.869495:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.869508:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.869518:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430827.869528:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787430827.869632:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14886 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.869650:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14886 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.869658:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:2.0:1787430827.869661:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787430827.869663:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74e00, rc 0) 00000100:00100000:2.0:1787430827.869693:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:11576:x1874256841495168:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 330us (980us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787430827.869699:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 201 00000100:00100000:1.0:1787430827.878849:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.879049:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841495424 00000100:00100000:2.0:1787430827.879059:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841495424 00000100:00100000:2.0:1787430827.879121:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:2.0:1787430827.879131:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+6:2374:x1874256841495424:12345-192.168.204.60@tcp:1:lfs.0 00010000:00010000:2.0:1787430827.879194:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.879215:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.879223:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430827.879227:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430827.879231:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.879278:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.879292:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 6 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.879307:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe059f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6685:1874256856157696:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430827.879451:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c66d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430827.883404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430827.883557:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841495552 00000100:00100000:3.0:1787430827.883568:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841495552 00002000:00100000:3.0:1787430827.883624:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0f2fe058e00 x1874256841495552/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:48/0 lens 504/0 e 0 to 0 dl 1787430838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787430827.883637:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe058e00 with x1874256841495552 ext(0->8) 00010000:00010000:3.0:1787430827.883646:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 7 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.883663:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 7 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430827.883671:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fe058e00 00000100:00100000:3.0:1787430827.883703:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:3.0:1787430827.883713:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841495552:12345-192.168.204.60@tcp:4:lfs.0 00000100:00100000:3.0:1787430827.884260:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841495552:12345-192.168.204.60@tcp:4:lfs.0 Request processed in 537us (854us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787430827.884268:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00002000:00100000:3.0:1787430827.884276:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0f2fe058e00 x1874256841495552/t4294967308(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:48/0 lens 504/448 e 0 to 0 dl 1787430838 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787430827.884285:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fe058e00 with x1874256841495552 ext(0->8) 00010000:00010000:3.0:1787430827.884291:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 9 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.884314:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 9 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787430827.884322:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0f2fe058e00 00000100:00100000:1.0:1787430827.884750:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe059f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6685:1874256856157696:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430827.884778:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430827.888762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.888941:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841495680 00000100:00100000:0.0:1787430827.888951:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841495680 00010000:00010000:0.0:1787430827.888992:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 9 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430827.889039:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:0.0:1787430827.889050:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841495680:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430827.889066:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787430827.889086:0:11667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787430827.889089:0:11667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787430827 00002000:00010000:0.0:1787430827.889091:0:11667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787430827 00002000:00010000:0.0:1787430827.889094:0:11667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787430827 00010000:00010000:0.0:1787430827.889100:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 9 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.889114:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 9 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.889153:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d88a58/0x1fa5b1e070e69b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14871 expref: 9 pid: 6683 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.889168:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430827.889173:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430827.889179:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.889190:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.889225:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430827.889294:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841495680:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 245us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.889303:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00010000:00010000:2.0:1787430827.889478:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889489:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889524:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889533:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889542:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889550:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430827.889554:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889563:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889576:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.889584:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a89cf74/0x1fa5b1e070e69b5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.889632:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841495424:12345-192.168.204.60@tcp:1:lfs.0 Request processed in 10502us (10795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430827.889640:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787430827.892815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.893092:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841495936 00000100:00100000:2.0:1787430827.893104:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841495936 00000100:00100000:2.0:1787430827.893171:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:2.0:1787430827.893183:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+43:11576:x1874256841495936:12345-192.168.204.60@tcp:35:lfs.0 00000004:00010000:2.0:1787430827.893264:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14886 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430827.893552:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787430827.893599:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787430827.894011:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787430827.894069:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.894085:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.894094:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.894132:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430827.894146:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 47 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430827.894161:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe059f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874256856157824:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430827.894263:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787430827.898983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430827.899082:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe059f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874256856157824:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430827.899126:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430827.899891:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841496064 00000100:00100000:0.0:1787430827.899899:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841496064 00010000:00010000:0.0:1787430827.899931:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 48 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430827.900002:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:0.0:1787430827.900012:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+48:2374:x1874256841496064:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430827.900027:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430827.900034:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 48 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.900054:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 48 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.900076:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14863 expref: 48 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.900093:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:0.0:1787430827.900097:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.900106:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.900113:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.900145:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430827.900190:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:2374:x1874256841496064:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 180us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.900197:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 76 00010000:00010000:3.0:1787430827.900258:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.900266:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430827.900392:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787430827.900569:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787430827.900660:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856157952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430827.900758:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430827.900792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856157952 00000100:00100000:3.0:1787430827.900795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856157952 00000100:00100000:3.0:1787430827.900828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430827.900834:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856157952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430827.900886:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856157952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430827.900892:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430827.900909:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c531d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787430827.900924:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1787430827.900929:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1787430827.900955:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2fe05e680, transno 4294967307 00000100:00100000:3.0:1787430827.900969:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856157952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787430827.901424:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787430827.901471:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856158080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430827.901502:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430827.901527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856158080 00000100:00100000:3.0:1787430827.901531:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856158080 00000100:00100000:3.0:1787430827.901551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430827.901558:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874256856158080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787430827.901681:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1874256856158080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (177us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787430827.901688:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430827.901706:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c531dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430827.901725:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874256856158080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787430827.901779:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787430827.901813:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.901822:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.901829:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.901835:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430827.901840:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.901849:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.901873:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430827.901876:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787430827.901881:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430827.901887:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69b62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430827.902041:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787430827.902134:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787430827.902144:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 291456816221ns, next at 292456814412ns, rc = 0 00000001:00080000:3.0:1787430827.902151:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787430827.902181:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d22f0600) 00010000:00010000:3.0:1787430827.902185:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787430827.902191:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69b4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14886 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430827.902284:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:11576:x1874256841495936:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 9102us (9478us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787430827.902292:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00000020:00080000:3.0:1787430827.902295:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787430827.902389:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430827.908390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.908621:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841496192 00000100:00100000:0.0:1787430827.908631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841496192 00000100:00100000:0.0:1787430827.908690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 202 00000100:00100000:0.0:1787430827.908701:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+50:11576:x1874256841496192:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430827.908726:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430827.908751:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69b69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1488d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.908839:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69b69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1488d expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.908854:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69b69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1488d expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430827.908873:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430827.908876:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430827.908880:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263c00, rc 0) 00000100:00100000:0.0:1787430827.908948:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:11576:x1874256841496192:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 248us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430827.908956:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 202 00000100:00100000:1.0:1787430827.912611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430827.912705:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841496448 00000100:00100000:0.0:1787430827.912716:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841496448 00000100:00100000:0.0:1787430827.912775:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:0.0:1787430827.912784:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+51:11576:x1874256841496448:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787430827.913008:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:11576:x1874256841496448:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 224us (408us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787430827.913015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:3.0:1787430828.023547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.023661:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841496576 00000100:00100000:1.0:1787430828.023670:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841496576 00000100:00100000:1.0:1787430828.023748:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 203 00000100:00100000:1.0:1787430828.023759:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:11586:x1874256841496576:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:1.0:1787430828.023848:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.023865:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.023878:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.023891:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.023898:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.023904:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024001:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024010:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024017:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787430828.024056:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024067:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024084:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024091:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024096:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430828.024101:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024108:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024122:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430828.024125:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430828.024141:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024148:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69b70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024165:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024170:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024175:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024180:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430828.024189:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024195:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024202:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5800) 00010000:00010000:1.0:1787430828.024204:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430828.024207:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024212:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69b77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024226:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024231:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024236:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024240:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430828.024243:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024258:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024266:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430828.024267:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430828.024277:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.024283:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430828.024640:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec165880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:11586:x1874256841496576:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 881us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430828.024650:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 203 00010000:00010000:0.0:1787430828.060838:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430828.080859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.080961:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841496832 00000100:00100000:0.0:1787430828.080971:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841496832 00000100:00100000:0.0:1787430828.081035:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 204 00000100:00100000:0.0:1787430828.081046:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+52:11589:x1874256841496832:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430828.081069:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430828.081110:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14894 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081194:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081208:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081219:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081233:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081241:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081263:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081425:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081434:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081442:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430828.081452:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787430828.081550:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081569:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081576:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081582:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.081586:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081593:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081605:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:0.0:1787430828.081608:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430828.081613:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081619:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081634:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081640:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081646:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081652:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.081661:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081667:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081676:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430828.081679:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430828.081682:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081688:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262200/0x1fa5b1e070e69b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081729:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14894 expref: 55 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081744:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14894 expref: 54 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.081751:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430828.081753:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430828.081755:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262800, rc 0) 00000100:00100000:0.0:1787430828.081821:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:11589:x1874256841496832:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 777us (972us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787430828.081829:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 204 00000100:00100000:3.0:1787430828.086907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.087153:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841496960 00000100:00100000:2.0:1787430828.087163:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841496960 00000100:00100000:2.0:1787430828.087222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 205 00000100:00100000:2.0:1787430828.087232:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:11589:x1874256841496960:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:2.0:1787430828.087313:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087357:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087370:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087397:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087404:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087410:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087416:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430828.087420:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087428:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087457:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430828.087460:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787430828.087465:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.087471:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430828.087738:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:11589:x1874256841496960:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 505us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.087745:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 205 00000100:00100000:0.0:1787430828.092528:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.092638:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841497216 00000100:00100000:3.0:1787430828.092648:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841497216 00000100:00100000:3.0:1787430828.092807:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:3.0:1787430828.092834:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+54:11589:x1874256841497216:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787430828.093085:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:11589:x1874256841497216:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 253us (565us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787430828.093094:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:3.0:1787430828.198541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.200289:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841497472 00000100:00100000:2.0:1787430828.200302:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841497472 00000100:00100000:2.0:1787430828.200378:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 206 00000100:00100000:2.0:1787430828.200394:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+55:11599:x1874256841497472:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787430828.200417:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430828.200420:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787430828.200453:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69b2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14878 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.200472:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:2.0:1787430828.200476:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430828.200488:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69baf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1489b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.201187:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69bb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.201223:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.201232:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430828.201256:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787430828.201436:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69baf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1489b expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.201456:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1489b expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.201464:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430828.201467:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430828.201469:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74000, rc 0) 00000100:00100000:2.0:1787430828.201533:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+56:11599:x1874256841497472:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1140us (3002us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787430828.201716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 206 00000100:00100000:0.0:1787430828.205413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.205602:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841497728 00000100:00100000:2.0:1787430828.205611:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841497728 00000100:00100000:2.0:1787430828.205657:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 207 00000100:00100000:2.0:1787430828.205666:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+56:11599:x1874256841497728:12345-192.168.204.60@tcp:36:bash.0 00010000:00010000:2.0:1787430828.205723:0:9043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787430828.205750:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69bb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1489b expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.205796:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14894 expref: 55 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.205809:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430828.205813:0:9043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430828.206020:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.206034:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.206044:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430828.206096:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787430828.206122:0:9043:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bafd23c reply state 000000005a7a4f81 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430828.206146:0:9043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430828.206238:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+57:11599:x1874256841497728:12345-192.168.204.60@tcp:36:bash.0 Request processed in 572us (834us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787430828.206255:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 207 00000020:00080000:2.0:1787430828.206260:0:9043:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787430828.208991:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.209008:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.209014:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.209020:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430828.209024:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.209031:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.209047:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:3.0:1787430828.209050:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430828.209054:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.209060:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e69bc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430828.213535:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.213746:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841497856 00000100:00100000:1.0:1787430828.213757:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841497856 00000100:00100000:1.0:1787430828.213820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 208 00000100:00100000:1.0:1787430828.213832:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+56:11599:x1874256841497856:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787430828.213859:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430828.213885:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69bcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148a2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.213969:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.213983:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.213996:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430828.214024:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787430828.214028:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430828.214046:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.214095:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69bcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.214114:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.214123:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430828.214125:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430828.214130:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4800, rc 0) 00000100:00100000:1.0:1787430828.214195:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+57:11599:x1874256841497856:12345-192.168.204.60@tcp:101:bash.0 Request processed in 365us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430828.214202:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 208 00000100:00100000:0.0:1787430828.218895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.218997:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841498112 00000100:00100000:3.0:1787430828.219007:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841498112 00000100:00100000:3.0:1787430828.219072:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:3.0:1787430828.219082:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+57:11599:x1874256841498112:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:3.0:1787430828.219352:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+58:11599:x1874256841498112:12345-192.168.204.60@tcp:35:bash.0 Request processed in 270us (464us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787430828.219360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:0.0:1787430828.252648:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856158208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430828.252719:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430828.253042:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856158208 00000100:00100000:3.0:1787430828.253050:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856158208 00000100:00100000:3.0:1787430828.253146:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787430828.253157:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856158208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787430828.253180:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430828.253307:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874256856158208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.253314:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787430828.253457:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856158208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430828.325795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.326364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841498240 00000100:00100000:3.0:1787430828.326376:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841498240 00000100:00100000:3.0:1787430828.326719:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 209 00000100:00100000:3.0:1787430828.326732:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+58:11605:x1874256841498240:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430828.329158:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430828.329193:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69bd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.329278:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69be0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.329293:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.329306:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430828.329696:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787430828.329701:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430828.329724:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.329752:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69bd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a9 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.329772:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a9 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.329782:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430828.329785:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430828.329788:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430828.329942:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841498240:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 3211us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.331893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 209 00000100:00100000:1.0:1787430828.340768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.340893:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841498368 00000100:00100000:0.0:1787430828.340902:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841498368 00000100:00100000:0.0:1787430828.340967:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 210 00000100:00100000:0.0:1787430828.340978:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841498368:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430828.340999:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430828.341020:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148b0 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341140:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341156:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341169:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341185:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341191:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341198:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341364:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341387:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341394:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430828.341449:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787430828.341453:0:6884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430828.341471:0:6884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341483:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341491:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341497:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341505:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341510:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.341515:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341522:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341534:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:0.0:1787430828.341900:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430828.341912:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341920:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69bee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341934:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341940:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341945:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341951:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.341954:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341959:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341967:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430828.341970:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430828.341983:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.341989:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69bf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.342020:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e69be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b0 expref: 61 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.342047:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b0 expref: 60 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.342054:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430828.342056:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430828.342059:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262a00, rc 0) 00000100:00100000:0.0:1787430828.342126:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11605:x1874256841498368:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1150us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.342134:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 210 00000100:00100000:0.0:1787430828.348829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.348913:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841498624 00000100:00100000:1.0:1787430828.348923:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841498624 00000100:00100000:1.0:1787430828.348987:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:1.0:1787430828.348998:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:2373:x1874256841498624:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430828.349013:0:8455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430828.349037:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e69bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b0 expref: 60 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.349059:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430828.349063:0:8455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430828.349124:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:2373:x1874256841498624:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430828.349132:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:2.0:1787430828.352784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.352894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841498752 00000100:00100000:1.0:1787430828.352904:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841498752 00000100:00100000:1.0:1787430828.352949:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 211 00000100:00100000:1.0:1787430828.352959:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841498752:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430828.352981:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430828.353003:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.353100:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.353115:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.353124:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.353159:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.353172:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 60 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430828.353185:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec150000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856158336:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430828.353285:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c78583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430828.355863:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec150000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856158336:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787430828.355890:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430828.361261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.362381:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841498880 00000100:00100000:1.0:1787430828.362393:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841498880 00010000:00010000:1.0:1787430828.362441:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 61 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430828.362541:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:1.0:1787430828.362552:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:2374:x1874256841498880:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430828.362569:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430828.362577:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 61 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.362592:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 61 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.362618:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69bd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a2 expref: 61 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.362638:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430828.362644:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.362654:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.362662:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.362698:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430828.362779:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:2374:x1874256841498880:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 228us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430828.362787:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00010000:00010000:3.0:1787430828.362885:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.362897:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430828.362917:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787430828.363130:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.363147:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.363164:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:3.0:1787430828.363167:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787430828.363170:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4a00, rc 0) 00000100:00100000:3.0:1787430828.363199:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11605:x1874256841498752:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 10241us (10424us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787430828.363207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 211 00000100:00100000:2.0:1787430828.369762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.371983:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841499136 00000100:00100000:0.0:1787430828.371998:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841499136 00000100:00100000:0.0:1787430828.372114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:0.0:1787430828.372125:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11605:x1874256841499136:12345-192.168.204.60@tcp:103:lfs.0 00010000:00010000:0.0:1787430828.372141:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430828.372166:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69b69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1488d expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.372188:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430828.372193:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430828.372275:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841499136:12345-192.168.204.60@tcp:103:lfs.0 Request processed in 151us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.372283:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:0.0:1787430828.380861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.380949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841499264 00000100:00100000:3.0:1787430828.380958:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841499264 00000100:00100000:3.0:1787430828.381018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 212 00000100:00100000:3.0:1787430828.381030:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841499264:12345-192.168.204.60@tcp:58:lfs.0 00010000:00010000:3.0:1787430828.381155:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.381175:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.381186:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430828.381422:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787430828.381766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841499264:12345-192.168.204.60@tcp:58:lfs.0 Request processed in 736us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.381775:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 212 00000100:00100000:2.0:1787430828.383810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.385364:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841499392 00000100:00100000:0.0:1787430828.385392:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841499392 00000100:00100000:0.0:1787430828.385709:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 213 00000100:00100000:0.0:1787430828.385720:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+59:11605:x1874256841499392:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430828.385743:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430828.385764:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148be expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.385820:0:6884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.385831:0:6884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 60 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.385850:0:6884:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.385862:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 60 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.385876:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430828.385879:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430828.385883:0:6884:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 60 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.385890:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263c00, rc 0) 00000100:00100000:0.0:1787430828.385959:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11605:x1874256841499392:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 241us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.385966:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 213 00000040:00080000:2.0:1787430828.702826:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430828.702835:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430828.702910:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787430828.702917:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787430828.703038:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2feaf5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856158464:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787430828.703164:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430828.711077:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2feaf5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856158464:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787430828.728144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.728408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841499520 00000100:00100000:3.0:1787430828.728427:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841499520 00000100:00100000:3.0:1787430828.728498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 214 00000100:00100000:3.0:1787430828.728509:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11606:x1874256841499520:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787430828.728553:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787430828.728653:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11606:x1874256841499520:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 145us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.728661:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 214 00000100:00100000:2.0:1787430828.738192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.738302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841499648 00000100:00100000:3.0:1787430828.738311:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841499648 00000100:00100000:3.0:1787430828.738380:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00100000:3.0:1787430828.738391:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11606:x1874256841499648:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787430828.738466:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738483:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738495:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738559:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738566:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738573:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738604:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738628:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738635:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430828.738671:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787430828.738675:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430828.738686:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738695:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738702:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738708:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738713:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430828.738717:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738725:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738736:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:3.0:1787430828.738739:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430828.738743:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738871:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69c26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738889:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738895:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738901:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738907:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430828.738909:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738917:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738926:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa0f2daf05a00) 00010000:00010000:3.0:1787430828.738928:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430828.738931:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738937:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738951:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738956:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738967:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738971:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430828.738974:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738980:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738987:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:3.0:1787430828.738989:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430828.738992:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.738998:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430828.739557:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11606:x1874256841499648:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 Request processed in 1164us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.739566:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00100000:1.0:1787430828.751190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.751366:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841499904 00000100:00100000:0.0:1787430828.751376:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841499904 00000100:00100000:0.0:1787430828.751439:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00100000:0.0:1787430828.751449:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+60:11606:x1874256841499904:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430828.751468:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430828.751486:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148c5 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751578:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751592:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751603:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430828.751615:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787430828.751710:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751719:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751726:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751731:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.751735:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751741:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751780:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430828.751783:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787430828.751788:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751794:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751836:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148c5 expref: 62 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751845:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:0.0:1787430828.751847:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430828.751852:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148c5 expref: 62 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.751860:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430828.752270:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:11606:x1874256841499904:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 821us (1090us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787430828.752279:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00100000:0.0:1787430828.767228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.768937:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841500032 00000100:00100000:2.0:1787430828.768952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841500032 00000100:00100000:2.0:1787430828.769075:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00100000:2.0:1787430828.769088:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:11606:x1874256841500032:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787430828.769142:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787430828.769302:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:11606:x1874256841500032:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 216us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.769311:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00100000:2.0:1787430828.776650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.776786:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841500288 00000100:00100000:3.0:1787430828.776796:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841500288 00000100:00100000:3.0:1787430828.776862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 218 00000100:00100000:3.0:1787430828.776874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:11606:x1874256841500288:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430828.776901:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430828.776905:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787430828.776998:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148a9 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.777033:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430828.777038:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430828.777053:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148cc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787430828.777878:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787430828.778083:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.778098:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.778109:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.779402:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148cc expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.779426:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148cc expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.779435:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430828.779438:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430828.779442:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a400, rc 0) 00000100:00100000:3.0:1787430828.779638:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+62:11606:x1874256841500288:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 2764us (2995us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787430828.779648:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 218 00000100:00100000:1.0:1787430828.783974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.784422:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841500544 00000100:00100000:0.0:1787430828.784434:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841500544 00000100:00100000:0.0:1787430828.784510:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 219 00000100:00100000:0.0:1787430828.784520:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+62:11606:x1874256841500544:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430828.784580:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430828.784607:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a400/0x1fa5b1e070e69c57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148cc expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784643:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:0.0:1787430828.784654:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430828.784678:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784691:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784700:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784757:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784766:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784773:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784858:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784865:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784872:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784878:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.784882:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784896:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784906:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:0.0:1787430828.784909:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430828.784913:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784919:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e69c65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784932:0:6884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784937:0:6884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784942:0:6884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784946:0:6884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430828.784949:0:6884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784954:0:6884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784960:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x82c4fd65 (ffffa0f2d2bc4800) 00010000:00010000:0.0:1787430828.784962:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430828.784965:0:6884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.784980:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x82c4fd65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430828.787579:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:11606:x1874256841500544:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 558us (1113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787430828.787593:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 219 00000100:00100000:0.0:1787430828.794813:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.794978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841500672 00000100:00100000:2.0:1787430828.794989:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841500672 00000100:00100000:2.0:1787430828.795056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 220 00000100:00100000:2.0:1787430828.795067:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+61:11606:x1874256841500672:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430828.795814:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430828.795843:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69c73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.795879:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.795908:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.795919:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.796195:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74c00/0x1fa5b1e070e69c73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.796647:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.796658:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:2.0:1787430828.796661:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430828.796664:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430828.796789:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+62:11606:x1874256841500672:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1723us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.796798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 220 00000100:00100000:2.0:1787430828.802876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.803368:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841500928 00000100:00100000:3.0:1787430828.803379:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841500928 00000100:00100000:3.0:1787430828.803448:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 221 00000100:00100000:3.0:1787430828.803458:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+62:11606:x1874256841500928:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787430828.803538:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.803553:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.803564:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430828.803809:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1787430828.803819:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 292358491232ns, next at 293358488540ns, rc = 0 00000004:00010000:3.0:1787430828.803901:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000875300a0 reply state 0000000065a1ca63 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430828.803909:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787430828.804224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+64:11606:x1874256841500928:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 765us (1357us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787430828.804231:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 221 00010000:00010000:3.0:1787430828.812041:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.812070:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.812079:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.812104:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430828.812109:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.812117:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.812135:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:3.0:1787430828.812138:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787430828.812144:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.812154:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430828.814152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.814315:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841501056 00000100:00100000:0.0:1787430828.814365:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841501056 00000100:00100000:0.0:1787430828.814417:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 222 00000100:00100000:0.0:1787430828.814429:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+63:11606:x1874256841501056:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430828.814455:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430828.814476:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148da expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.814537:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 64 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.814551:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 64 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.814570:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:0.0:1787430828.814573:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430828.814577:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430828.814648:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+64:11606:x1874256841501056:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 220us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.814672:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 222 00000100:00100000:1.0:1787430828.822439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.822522:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841501184 00000100:00100000:3.0:1787430828.822531:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841501184 00000100:00100000:3.0:1787430828.822590:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787430828.822602:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841501184:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787430828.822886:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:2374:x1874256841501184:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 284us (467us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787430828.822894:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:2.0:1787430828.837818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.837959:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841501440 00000100:00100000:3.0:1787430828.837970:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841501440 00000100:00100000:3.0:1787430828.838031:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:3.0:1787430828.838042:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+64:11606:x1874256841501440:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430828.838302:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+65:11606:x1874256841501440:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 261us (491us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787430828.838324:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:0.0:1787430828.849406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.849588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841501696 00000100:00100000:2.0:1787430828.849601:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841501696 00000100:00100000:2.0:1787430828.849668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 223 00000100:00100000:2.0:1787430828.849679:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+65:11606:x1874256841501696:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787430828.849808:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+65:11606:x1874256841501696:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 130us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.849832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 223 00000100:00100000:1.0:1787430828.852455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430828.852577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841501824 00000100:00100000:3.0:1787430828.852587:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841501824 00000100:00100000:3.0:1787430828.852647:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 224 00000100:00100000:3.0:1787430828.852657:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+65:11606:x1874256841501824:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430828.852677:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430828.852698:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.852779:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.852793:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.852803:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430828.852839:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430828.852857:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.852885:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69c8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e1 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.852906:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e1 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430828.852915:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:3.0:1787430828.852932:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787430828.852936:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430828.853003:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+66:11606:x1874256841501824:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 347us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430828.853011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 224 00000100:00100000:1.0:1787430828.857367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.857569:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841501952 00000100:00100000:2.0:1787430828.857580:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841501952 00000100:00100000:2.0:1787430828.857640:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:2.0:1787430828.857651:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+10:2373:x1874256841501952:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430828.857671:0:8633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430828.857695:0:8633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148e8 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430828.857727:0:8633:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a07ac, blocks: 0x1 00010000:00010000:2.0:1787430828.857771:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=292s v=(0 0) 00010000:00010000:2.0:1787430828.857776:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430828.857787:0:8633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 11 pid: 8633 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.857808:0:8633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 11 pid: 8633 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.857822:0:8633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74000, rc 0) 00000100:00100000:2.0:1787430828.857889:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:2373:x1874256841501952:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 239us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.857896:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:2.0:1787430828.863819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.863980:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502208 00000100:00100000:1.0:1787430828.863990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502208 00000100:00100000:1.0:1787430828.864046:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 225 00000100:00100000:1.0:1787430828.864057:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+66:11606:x1874256841502208:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787430828.864166:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+66:11606:x1874256841502208:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 111us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430828.864174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 225 00000100:00100000:3.0:1787430828.867850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.868078:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502336 00000100:00100000:0.0:1787430828.868089:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502336 00000100:00100000:0.0:1787430828.868148:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:0.0:1787430828.868158:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:11606:x1874256841502336:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430828.868176:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430828.868194:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148ef expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.868227:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.868246:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430828.868250:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430828.868256:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.868291:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.868305:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430828.868319:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c7425f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1874256856158592:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430828.868481:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430828.872845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.873027:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c7425f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6686:1874256856158592:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430828.873061:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430828.873082:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263800, rc 0) 00000100:00100000:0.0:1787430828.873153:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:11606:x1874256841502336:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 4995us (5315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.873162:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:1.0:1787430828.873749:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502464 00000100:00100000:1.0:1787430828.873769:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502464 00010000:00010000:1.0:1787430828.873805:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430828.873846:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:1.0:1787430828.873855:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:2374:x1874256841502464:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430828.873869:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430828.873893:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.873926:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.874169:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69c9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e8 expref: 12 pid: 8633 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.874190:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430828.874195:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430828.874204:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.874215:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.874265:0:11667:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430828.874280:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec153800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11667:1874256856158720:192.168.204.60@tcp:105: 00000100:00100000:1.0:1787430828.874400:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c78583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430828.879019:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec153800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11667:1874256856158720:192.168.204.60@tcp:105: 00010000:00010000:1.0:1787430828.879045:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430828.879105:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:2374:x1874256841502464:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 5250us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430828.879116:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:3.0:1787430828.884785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430828.885185:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502592 00000100:00100000:1.0:1787430828.885195:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502592 00002000:00100000:1.0:1787430828.885256:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa0f2fee95c00 x1874256841502592/t0(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:49/0 lens 504/0 e 0 to 0 dl 1787430839 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430828.885268:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fee95c00 with x1874256841502592 ext(0->12) 00002000:00010000:1.0:1787430828.885275:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2fee95c00 00000100:00100000:1.0:1787430828.885307:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:1.0:1787430828.885318:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+11:2373:x1874256841502592:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787430828.885904:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841502592:12345-192.168.204.60@tcp:4:lhsmtool_posix.0 Request processed in 585us (1127us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787430828.885913:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00002000:00100000:1.0:1787430828.885920:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa0f2fee95c00 x1874256841502592/t4294967320(0) o4->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:49/0 lens 504/448 e 0 to 0 dl 1787430839 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787430828.885929:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f2fee95c00 with x1874256841502592 ext(0->12) 00002000:00010000:1.0:1787430828.885933:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f2fee95c00 00000100:00100000:3.0:1787430828.889363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.889509:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502720 00000100:00100000:0.0:1787430828.889519:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502720 00000100:00100000:0.0:1787430828.889581:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 226 00000100:00100000:0.0:1787430828.889592:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2d8276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+66:11606:x1874256841502720:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787430828.974852:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:3.0:1787430828.974906:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:0.0:1787430828.974982:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2d8276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+47:11606:x1874256841502720:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 Request processed in 85385us (85650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430828.974994:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 226 00000100:00100000:1.0:1787430828.975210:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430828.975243:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856158848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787430828.975301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430828.975354:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856158848 00000100:00100000:2.0:1787430828.975364:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856158848 00000100:00100000:2.0:1787430828.975444:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787430828.975453:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856158848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787430828.975476:0:8633:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787430828.975501:0:8633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.975521:0:8633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.975530:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787430828.975535:0:8633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430828.975540:0:8633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.975570:0:8633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.975584:0:8633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 12 pid: 6683 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430828.975596:0:8633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8633:1874256856158976:192.168.204.60@tcp:104: 00000100:00080000:1.0:1787430828.975781:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1787430828.977263:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2c64d1d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787430828.977271:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c6314b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2c64d1540 00000020:00080000:3.0:1787430828.977275:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c6314300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2f7d43000 00000001:00080000:3.0:1787430828.977317:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787430828.977338:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787430828.977751:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787430828.977768:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2c66d3cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787430828.977772:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c5a1ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2c66d3f00 00000020:00080000:3.0:1787430828.977775:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2c5a1ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2fde90c00 00000020:00080000:1.0:1787430828.979362:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787430828.979580:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787430828.980548:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430828.980578:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856159104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787430828.980643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430828.980709:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856159104 00000100:00100000:1.0:1787430828.980731:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856159104 00000100:00100000:1.0:1787430828.980785:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787430828.980795:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856159104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787430828.980821:0:6683:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787430828.980854:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a07ab, atime: 0x6a8a07ab, ctime: 0x6a8a07ab, blocks: 0x1 00010000:00010000:1.0:1787430828.980862:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.980878:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=292s v=(0 0) 00010000:00010000:1.0:1787430828.980882:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430828.980889:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.980904:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.980914:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.980923:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.981172:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787430828.981529:0:8633:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2e86000 going to sleep for 11 seconds 00000100:00100000:0.0:1787430828.981896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430828.982028:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787430828.982037:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787430828.982470:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874256856159104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1675us (1824us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787430828.982479:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787430828.982496:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502848 00000100:00100000:1.0:1787430828.982506:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502848 00000100:00100000:1.0:1787430828.982532:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:1.0:1787430828.982540:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2373:x1874256841502848:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787430828.982592:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430828.982600:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.982611:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430828.982615:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.982626:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.982644:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.982651:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69cb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430828.982669:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430828.982671:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430828.982673:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787430828.982703:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2d8277480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787430828.982709:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856159104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787430828.982783:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2d8275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856159232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787430828.982820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430828.983474:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787430828.983486:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856159232 00000100:00100000:0.0:1787430828.983490:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856159232 00000100:00100000:0.0:1787430828.983628:0:12537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787430828.983639:0:12537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856159232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787430828.983831:0:12537:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787430828.983835:0:12537:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787430828 00002000:00010000:0.0:1787430828.983844:0:12537:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787430828.983846:0:12537:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787430828 -> 1787430828 00002000:00010000:0.0:1787430828.983849:0:12537:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 9 00000100:00100000:0.0:1787430828.983904:0:12537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3309:x1874256856159232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (1082us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787430828.983913:0:12537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000004:00080000:0.0:1787430828.984286:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2d8275c00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787430828.984294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2d8275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856159232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787430828.987323:0:8633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8633:1874256856158976:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430828.987375:0:8633:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430828.990454:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430828.998951:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841502976 00000100:00100000:2.0:1787430828.998964:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841502976 00010000:00010000:2.0:1787430828.999123:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 14 pid: 6683 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430828.999209:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:2.0:1787430828.999220:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+14:2374:x1874256841502976:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430828.999244:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430828.999251:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 14 pid: 6683 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.999265:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 14 pid: 6683 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.999299:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000935c3e4f/0x1fa5b1e070e69a6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1484e expref: 14 pid: 6683 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.999316:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430828.999320:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430828.999358:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.999368:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430828.999396:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430828.999454:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+13:2374:x1874256841502976:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 236us (9133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430828.999471:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00010000:00010000:0.0:1787430829.001641:0:8633:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.001661:0:8633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.001674:0:8633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.001684:0:8633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.001705:0:8633:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430829.001922:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430829.001936:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.001946:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430829.001951:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.001960:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.001981:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.001998:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.002022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430829.002025:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430829.002027:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430829.002321:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1874256856158848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26866us (27017us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787430829.002360:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1787430829.002502:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2ec153800/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787430829.002509:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856158848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787430829.032636:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+12:2373:x1874256841502848:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 Request processed in 50084us (50730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430829.032648:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000001:00080000:2.0:1787430829.032734:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1787430829.032763:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:1.0:1787430829.036879:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.037088:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841503232 00000100:00100000:0.0:1787430829.037100:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841503232 00000100:00100000:0.0:1787430829.037191:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 227 00000100:00100000:0.0:1787430829.037203:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11606:x1874256841503232:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430829.037265:0:6884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430829.037292:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a600/0x1fa5b1e070e69c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148e1 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.037311:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:0.0:1787430829.037317:0:6884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430829.037404:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787430829.037694:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787430829.037729:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.037739:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430829.037966:0:6884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4a7da4e reply state 0000000061a215d7 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.037976:0:6884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430829.038137:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:11606:x1874256841503232:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 934us (1267us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787430829.038145:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 227 00000100:00100000:0.0:1787430829.045643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787430829.045865:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.045879:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.045886:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.045900:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430829.045905:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.045913:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.045931:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:3.0:1787430829.045934:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430829.045939:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.045945:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263600/0x1fa5b1e070e69cb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430829.046003:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841503360 00000100:00100000:1.0:1787430829.046022:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841503360 00000100:00100000:1.0:1787430829.046160:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:1.0:1787430829.046172:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841503360:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787430829.046402:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787430829.046406:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787430828 -> 1787430827 00002000:00010000:1.0:1787430829.046417:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787430827 00002000:00010000:1.0:1787430829.046420:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787430828 -> 1787430827 00002000:00010000:1.0:1787430829.046422:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 9 -> 11 00000100:00100000:1.0:1787430829.046493:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841503360:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 322us (862us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787430829.046501:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00080000:3.0:1787430829.046938:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430829.050906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.050993:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841503616 00000100:00100000:0.0:1787430829.051005:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841503616 00000100:00100000:0.0:1787430829.051065:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 228 00000100:00100000:0.0:1787430829.051076:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11606:x1874256841503616:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787430829.051145:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.051163:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.051172:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.051205:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.051219:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 20 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.051244:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856159360:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430829.051529:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430829.054826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430829.055004:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841503744 00000100:00100000:3.0:1787430829.055013:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841503744 00010000:00010000:3.0:1787430829.055053:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 21 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430829.055096:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:3.0:1787430829.055116:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:2373:x1874256841503744:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430829.055130:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430829.055137:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 21 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.055149:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 21 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.055186:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:3.0:1787430829.055191:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.055201:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.055208:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.055239:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430829.055301:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:2373:x1874256841503744:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 186us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430829.055308:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00010000:00010000:0.0:1787430829.056880:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74600/0x1fa5b1e070e69c7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148d3 expref: 20 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.056905:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874256856159360:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430829.056928:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.056957:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.056963:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.056993:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.057000:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.057006:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.057011:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430829.057015:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.057023:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.057038:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:0.0:1787430829.057041:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787430829.057045:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.057050:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.057142:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11606:x1874256841503616:12345-192.168.204.60@tcp:55:lhsmtool_posix.0 Request processed in 6067us (6249us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787430829.057157:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 228 00000100:00100000:2.0:1787430829.060236:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.060314:0:12537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841503872 00000100:00100000:0.0:1787430829.060323:0:12537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841503872 00000100:00100000:0.0:1787430829.060425:0:12537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:0.0:1787430829.060438:0:12537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841503872:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787430829.060485:0:12537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.060506:0:12537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.060515:0:12537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430829.060519:0:12537:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787430829.060524:0:12537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.060563:0:12537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.060576:0:12537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 8 pid: 6686 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.060591:0:12537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12537:1874256856159488:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430829.060665:0:12537:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430829.063273:0:12537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12537:1874256856159488:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430829.063314:0:12537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430829.065214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430829.065316:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841504000 00000100:00100000:1.0:1787430829.065360:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841504000 00010000:00010000:1.0:1787430829.065401:0:11667:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 9 pid: 6686 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430829.065440:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:1.0:1787430829.065449:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+9:2374:x1874256841504000:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430829.065464:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430829.065486:0:11667:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 9 pid: 6686 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.065500:0:11667:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 9 pid: 6686 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.065523:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e69ca4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148ef expref: 9 pid: 6686 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.065551:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430829.065555:0:11667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430829.065561:0:11667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.065571:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.065599:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430829.065654:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841504000:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 206us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430829.065663:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00010000:00010000:0.0:1787430829.066605:0:12537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066620:0:12537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066651:0:12537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066659:0:12537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066668:0:12537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066677:0:12537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430829.066681:0:12537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066690:0:12537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066706:0:12537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.066725:0:12537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098e6068e/0x1fa5b1e070e69cc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.066809:0:12537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841503872:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 Request processed in 6372us (6589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430829.066818:0:12537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:2.0:1787430829.071174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.071255:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841504256 00000100:00100000:0.0:1787430829.071266:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841504256 00000100:00100000:0.0:1787430829.071367:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 229 00000100:00100000:0.0:1787430829.071379:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11606:x1874256841504256:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787430829.071469:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071488:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071499:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071714:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071725:0:9043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 20 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071734:0:9043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071786:0:9043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 20 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.071799:0:9043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 20 pid: 6884 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.071812:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856159616:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430829.071898:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c64d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430829.076220:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856159616:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430829.076264:0:9043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430829.077300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430829.077642:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841504384 00000100:00100000:1.0:1787430829.077650:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841504384 00010000:00010000:1.0:1787430829.077691:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 21 pid: 6884 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430829.077739:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:1.0:1787430829.077750:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:2373:x1874256841504384:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430829.077764:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430829.077773:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 21 pid: 6884 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.077786:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 21 pid: 6884 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.077826:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e69c88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148da expref: 21 pid: 6884 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.077845:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:1.0:1787430829.077850:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.077859:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.077866:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.077898:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430829.077960:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:2373:x1874256841504384:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 211us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430829.077969:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 82 00010000:00010000:0.0:1787430829.078603:0:9043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.078613:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430829.078816:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787430829.078964:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787430829.079011:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787430829.079103:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856159744:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787430829.079163:0:9043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430829.079201:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430829.079369:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856159744 00000100:00100000:3.0:1787430829.079376:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856159744 00000100:00100000:3.0:1787430829.079431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430829.079440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9043:x1874256856159744:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787430829.079513:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9043:x1874256856159744:12345-0@lo:1000:mdt00_004.0 Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430829.079521:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430829.079875:0:9043:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1787430829.079881:0:9043:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1787430829.080098:0:9043:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0f2d8275c00 x1874256856159232/t4294967321(4294967321) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787430844 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430829.080128:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856159744:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787430829.083991:0:9043:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787430829.084096:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856159872:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787430829.084298:0:9043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430829.084503:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787430829.084662:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430829.084880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856159872 00000100:00100000:3.0:1787430829.084889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856159872 00000100:00100000:2.0:1787430829.085066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787430829.085076:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9043:x1874256856159872:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787430829.085320:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:9043:x1874256856159872:12345-0@lo:1000:mdt00_004.0 Request processed in 244us (1020us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787430829.085584:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787430829.085725:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9043:1874256856159872:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787430829.085776:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085787:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085820:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085826:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430829.085830:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085838:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085853:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d22f0e00) 00010000:00010000:1.0:1787430829.085856:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430829.085861:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085868:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e69cd5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085900:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085907:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085913:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085918:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147ae00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430829.085921:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085937:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085945:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430829.085947:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430829.085953:0:9043:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 23 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085964:0:9043:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 23 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.085973:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 23 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.086008:0:9043:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 23 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430829.086021:0:9043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856160000:192.168.204.60@tcp:105: 00000100:00100000:1.0:1787430829.086108:0:9043:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430829.090305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430829.090465:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841504512 00000100:00100000:3.0:1787430829.090475:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841504512 00000100:00100000:3.0:1787430829.090536:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:3.0:1787430829.090547:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11605:x1874256841504512:12345-192.168.204.60@tcp:49:lfs.0 00000100:00100000:2.0:1787430829.091288:0:9043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9043:1874256856160000:192.168.204.60@tcp:105: 00010000:00010000:2.0:1787430829.091317:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091493:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69c18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091535:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091550:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091560:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091584:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091591:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091598:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091604:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430829.091608:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091616:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091627:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430829.091631:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430829.091634:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091640:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091652:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091659:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091665:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091676:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430829.091679:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091685:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091694:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430829.091696:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430829.091699:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.091705:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e69cce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430829.092088:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11605:x1874256841504512:12345-192.168.204.60@tcp:49:lfs.0 Request processed in 1539us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430829.092109:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:1.0:1787430829.094822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430829.094900:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841504768 00000100:00100000:3.0:1787430829.094911:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841504768 00000100:00100000:3.0:1787430829.094968:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 230 00000100:00100000:3.0:1787430829.094979:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11605:x1874256841504768:12345-192.168.204.60@tcp:58:lfs.0 00000040:00080000:3.0:1787430829.095593:0:6884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787430829.095677:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11605:x1874256841504768:12345-192.168.204.60@tcp:58:lfs.0 Request processed in 699us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430829.095685:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 230 00000040:00080000:0.0:1787430829.100859:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430829.100870:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430829.100904:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787430829.100910:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430829.101036:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856160128:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787430829.102394:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f7ffe780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430829.103237:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11606:x1874256841504256:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 31842us (32056us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787430829.103251:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 229 00000020:00080000:2.0:1787430829.103259:0:9043:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787430829.112640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430829.112765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.112953:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841505024 00000100:00100000:0.0:1787430829.112962:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841505024 00000100:00100000:0.0:1787430829.113021:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:0.0:1787430829.113031:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+24:11606:x1874256841505024:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787430829.113121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841505152 00000100:00100000:1.0:1787430829.113126:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841505152 00000100:00100000:1.0:1787430829.113159:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 231 00000100:00100000:1.0:1787430829.113168:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+25:11607:x1874256841505152:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787430829.113186:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787430829.113294:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11607:x1874256841505152:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430829.113302:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 231 00000004:00080000:0.0:1787430829.113706:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787430829.113805:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787430829.113870:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.113887:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.113898:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.113907:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.113913:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.113930:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.113952:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787430829.114020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+26:11606:x1874256841505024:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 989us (1389us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787430829.114027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000020:00080000:0.0:1787430829.114031:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787430829.114674:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c7427b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1874256856160128:192.168.204.60@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1787430829.116562:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430829.116574:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.116585:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430829.116589:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.116599:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.116616:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0f2d2bc4800) 00010000:00010000:1.0:1787430829.116618:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787430829.116623:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.116629:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262600/0x1fa5b1e070e69ce3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.116649:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430829.116651:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430829.116652:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430829.116798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430829.116934:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841505408 00000100:00100000:3.0:1787430829.116943:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841505408 00000100:00100000:3.0:1787430829.117001:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 232 00000100:00100000:3.0:1787430829.117013:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+25:11607:x1874256841505408:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430829.117033:0:6884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430829.117049:0:6884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69cea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148f6 expref: -99 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.117153:0:6884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.117166:0:6884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.117175:0:6884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430829.117201:0:6884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787430829.117600:0:6884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69cea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148f6 expref: 28 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.117618:0:6884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148f6 expref: 27 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.117625:0:6884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:3.0:1787430829.117627:0:6884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787430829.117630:0:6884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b600, rc 0) 00000100:00100000:3.0:1787430829.117692:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11607:x1874256841505408:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 680us (896us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787430829.117700:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 232 00000100:00100000:0.0:1787430829.123378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430829.123466:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841505664 00000100:00100000:2.0:1787430829.123476:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841505664 00000100:00100000:2.0:1787430829.123537:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 233 00000100:00100000:2.0:1787430829.123550:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+27:11607:x1874256841505664:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787430829.123637:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123673:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123685:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123892:0:9043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123901:0:9043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123908:0:9043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123914:0:9043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430829.123918:0:9043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123924:0:9043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123935:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430829.123938:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787430829.123942:0:9043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430829.123948:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75800/0x1fa5b1e070e69cff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430829.124100:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11607:x1874256841505664:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 552us (732us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787430829.124114:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 233 00000040:00080000:3.0:1787430829.124295:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787430829.124300:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787430829.124807:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787430829.124815:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787430829.134672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.135047:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841505920 00000100:00100000:0.0:1787430829.135058:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841505920 00000100:00100000:0.0:1787430829.135132:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787430829.135143:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+28:11607:x1874256841505920:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787430829.135794:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11607:x1874256841505920:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 650us (1130us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787430829.135805:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787430829.157815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430829.158443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841506048 00000100:00100000:1.0:1787430829.158454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841506048 00000100:00100000:1.0:1787430829.158522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 234 00000100:00100000:1.0:1787430829.158532:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+29:11609:x1874256841506048:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787430829.158558:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430829.158593:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69d06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc148fd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.158658:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.158673:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.158684:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.158700:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.158708:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.158714:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.159242:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.159257:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.159265:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.159301:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430829.159432:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 30 pid: 5837 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430829.159448:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856160256:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430829.159594:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430829.164495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430829.164610:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874256856160256:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430829.164639:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430829.164826:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841506304 00000100:00100000:2.0:1787430829.164834:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841506304 00000100:00100000:2.0:1787430829.164900:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:2.0:1787430829.164911:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:5605:x1874256841506304:12345-192.168.204.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787430829.165423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:5605:x1874256841506304:12345-192.168.204.60@tcp:35:ldlm_bl.0 Request processed in 512us (938us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787430829.165431:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:2.0:1787430829.169095:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430829.169708:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841506432 00000100:00100000:0.0:1787430829.169718:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841506432 00010000:00010000:0.0:1787430829.169815:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 32 pid: 5837 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430829.169912:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:0.0:1787430829.169923:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:2374:x1874256841506432:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430829.169940:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430829.169948:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 32 pid: 5837 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.169976:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 32 pid: 5837 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.169999:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4a00/0x1fa5b1e070e69c0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148b7 expref: 32 pid: 5837 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.170029:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:0.0:1787430829.170035:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.170045:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.170053:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430829.170086:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430829.170154:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+31:2374:x1874256841506432:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 232us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430829.170162:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00010000:00010000:3.0:1787430829.170239:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170248:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430829.170302:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787430829.170307:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430829.170364:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170379:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170390:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170396:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170403:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170408:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430829.170411:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170418:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170427:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:3.0:1787430829.170430:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430829.170433:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170439:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4800/0x1fa5b1e070e69d0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170461:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170466:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170471:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170476:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430829.170478:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170483:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170491:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0f2d0ce5400) 00010000:00010000:3.0:1787430829.170494:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430829.170496:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170501:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a4400/0x1fa5b1e070e69d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170536:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5e00/0x1fa5b1e070e69d06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148fd expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170549:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148fd expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430829.170567:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:3.0:1787430829.170569:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430829.170572:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5200, rc 0) 00000100:00100000:3.0:1787430829.170600:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11609:x1874256841506048:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 12070us (12796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430829.170607:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 234 00000100:00100000:3.0:1787430829.276743:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430829.276771:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856160384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430829.276858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430829.277113:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856160384 00000100:00100000:1.0:1787430829.277121:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856160384 00000100:00100000:1.0:1787430829.277176:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787430829.277187:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1874256856160384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430829.277211:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787430829.277284:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1874256856160384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430829.277292:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430829.277388:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856160384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430829.284913:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856160512:0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430829.285080:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787430829.285087:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856160640:0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430829.285142:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856160896:0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430829.285183:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430829.285188:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856160768:0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285209:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430829.285256:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856160640 00000100:00100000:2.0:1787430829.285264:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856160640 00000100:00100000:2.0:1787430829.285314:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856160896 00000100:00100000:2.0:1787430829.285317:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856160896 00000100:00100000:2.0:1787430829.285365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856160768 00000100:00100000:2.0:1787430829.285375:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856160768 00000100:00100000:2.0:1787430829.285398:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787430829.285418:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856160640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285471:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874256856160640:12345-0@lo:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430829.285478:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787430829.285493:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430829.285499:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856160896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285529:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874256856160896:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430829.285535:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787430829.285546:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787430829.285553:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856160768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856160768:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430829.285584:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1787430829.285604:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430829.285632:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856160768:0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285642:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1874256856160896:0@lo:400:kworker.0 00000100:00100000:2.0:1787430829.285673:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874256856160640:0@lo:400:kworker.0 00000100:00100000:3.0:1787430829.285901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856160512 00000100:00100000:3.0:1787430829.285906:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856160512 00000100:00100000:3.0:1787430829.285954:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787430829.285961:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856160512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430829.285996:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3307:x1874256856160512:12345-0@lo:400:kworker.0 Request processed in 36us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430829.286001:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787430829.286136:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856160512:0@lo:400:kworker.0 00000040:00080000:2.0:1787430829.989364:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787430829.989375:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787430829.989514:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787430829.989526:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787430830.108433:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430830.184048:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430830.184058:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430830.184093:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787430830.184100:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787430830.190694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430830.190791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841506688 00000100:00100000:2.0:1787430830.190801:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841506688 00000100:00100000:2.0:1787430830.190855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 235 00000100:00100000:2.0:1787430830.190865:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+30:11632:x1874256841506688:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787430830.190892:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430830.190915:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69d22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14904 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.191018:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69d29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.191033:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.191045:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430830.191057:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787430830.191224:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74000/0x1fa5b1e070e69d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14904 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.191243:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14904 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.191251:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:2.0:1787430830.191254:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787430830.191259:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74a00, rc 0) 00000100:00100000:2.0:1787430830.194480:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11632:x1874256841506688:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 3604us (3783us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787430830.194526:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 235 00000100:00100000:2.0:1787430830.199833:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430830.199995:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841506816 00000100:00100000:3.0:1787430830.200006:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841506816 00000100:00100000:3.0:1787430830.200075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 236 00000100:00100000:3.0:1787430830.200093:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11632:x1874256841506816:12345-192.168.204.60@tcp:54:lfs.0 00010000:00010000:3.0:1787430830.200159:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200176:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200213:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200241:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200248:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200255:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200261:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430830.200264:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200271:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200282:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:3.0:1787430830.200285:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430830.200289:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430830.200295:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430830.200687:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:11632:x1874256841506816:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 594us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.200697:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 236 00000100:00100000:1.0:1787430830.300506:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430830.300675:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841506944 00000100:00100000:2.0:1787430830.300685:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841506944 00000100:00100000:2.0:1787430830.300749:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:2.0:1787430830.300761:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2374:x1874256841506944:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:2.0:1787430830.300779:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430830.300799:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69d3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1490b expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787430830.300828:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8a07ab, atime: 0x6a8a07ab, ctime: 0x6a8a07ab, blocks: 0xb 00010000:00010000:2.0:1787430830.300848:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1787430830.300852:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430830.300861:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69d3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1490b expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.300878:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69d3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1490b expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430830.300890:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74000, rc 0) 00000100:00100000:2.0:1787430830.300948:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841506944:12345-192.168.204.60@tcp:101:cat.0 Request processed in 189us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430830.300971:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787430830.307443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430830.307569:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507072 00000100:00100000:2.0:1787430830.307580:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507072 00002000:00100000:2.0:1787430830.307631:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa0f1c7426300 x1874256841507072/t0(0) o3->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:51/0 lens 488/0 e 0 to 0 dl 1787430841 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430830.307642:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f1c7426300 with x1874256841507072 ext(0->4095) 00002000:00010000:2.0:1787430830.307647:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f1c7426300 00000100:00100000:2.0:1787430830.307671:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430830.307681:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841507072:12345-192.168.204.60@tcp:3:cat.0 00000100:00100000:2.0:1787430830.307954:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2373:x1874256841507072:12345-192.168.204.60@tcp:3:cat.0 Request processed in 273us (519us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787430830.307962:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00002000:00100000:2.0:1787430830.307969:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa0f1c7426300 x1874256841507072/t0(0) o3->711a801a-27eb-4d09-8ae0-8dc5ece71a10@192.168.204.60@tcp:51/0 lens 488/4536 e 0 to 0 dl 1787430841 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787430830.307976:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0f1c7426300 with x1874256841507072 ext(0->4095) 00002000:00010000:2.0:1787430830.307980:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0f1c7426300 00010000:00010000:0.0:1787430831.133886:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787430831.384862:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787430831.384891:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1787430832.156497:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430832.157031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430832.157073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430832.157108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430832.157137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430832.157159:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430832.157215:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507456 00000100:00100000:0.0:1787430832.157225:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507456 00000100:00100000:0.0:1787430832.157283:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507584 00000100:00100000:0.0:1787430832.157287:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507584 00000100:00100000:0.0:1787430832.157308:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787430832.157317:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c34f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841507456:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:1.0:1787430832.157431:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787430832.157436:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430832.157479:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c34f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841507456:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 161us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430832.157488:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787430832.157661:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:0.0:1787430832.157668:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841507584:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430832.157692:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+8:2374:x1874256841507584:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430832.157697:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:3.0:1787430832.157913:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507712 00000100:00100000:3.0:1787430832.157919:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507712 00000100:00100000:3.0:1787430832.157968:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507328 00000100:00100000:3.0:1787430832.157971:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507328 00000100:00100000:3.0:1787430832.158011:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:3.0:1787430832.158017:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841507712:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430832.158054:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2374:x1874256841507712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430832.158060:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:3.0:1787430832.158077:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:3.0:1787430832.158084:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:2374:x1874256841507328:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430832.158108:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711a801a-27eb-4d09-8ae0-8dc5ece71a10+32:2374:x1874256841507328:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430832.158114:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:2.0:1787430832.158265:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507200 00000100:00100000:2.0:1787430832.158270:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507200 00000100:00100000:2.0:1787430832.158303:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 283 00000100:00100000:2.0:1787430832.158309:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841507200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430832.158372:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841507200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 62us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430832.158379:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 283 00000100:00080000:1.0:1787430832.161437:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787430833.180541:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430833.372536:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430833.372561:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856161024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430833.372634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430833.372738:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161024 00000100:00100000:1.0:1787430833.372747:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161024 00000100:00100000:1.0:1787430833.372828:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787430833.372839:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856161024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787430833.372873:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430833.372923:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856161024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430833.372930:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787430833.372971:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787430833.372976:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787430833.372998:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2d8277480, transno 4294967310 00000100:00100000:1.0:1787430833.373016:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856161024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787430833.373431:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430834.212540:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430834.397052:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856161152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430834.397138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430834.397199:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856161664:0@lo:400:kworker.0 00000100:00100000:1.0:1787430834.397901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430834.397945:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430834.397952:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787430834.399102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430834.399188:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161152 00000100:00100000:1.0:1787430834.399196:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161152 00000100:00100000:1.0:1787430834.399597:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430834.399609:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1874256856161152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430834.399649:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430834.399708:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1874256856161152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430834.399726:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430834.399753:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161664 00000100:00100000:1.0:1787430834.399757:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161664 00000100:00100000:1.0:1787430834.400572:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787430834.400582:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430834.400632:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856161664:12345-0@lo:400:kworker.0 Request processed in 54us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430834.400638:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787430834.400658:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430834.400711:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856161664:0@lo:400:kworker.0 00000100:00100000:1.0:1787430834.400730:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856161152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430834.401977:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856161280:0@lo:400:kworker.0 00000100:00100000:3.0:1787430834.402644:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430834.406165:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161280 00000100:00100000:3.0:1787430834.406179:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161280 00000100:00100000:3.0:1787430834.406230:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787430834.406240:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856161280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430834.406368:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856161280:12345-0@lo:400:kworker.0 Request processed in 128us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430834.406376:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787430834.410218:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856161408:0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.410309:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430834.410388:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856161920:0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.410411:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430834.410460:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161536 00000100:00100000:2.0:1787430834.410469:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161536 00000100:00100000:2.0:1787430834.410520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161408 00000100:00100000:2.0:1787430834.410523:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161408 00000100:00100000:2.0:1787430834.410549:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787430834.410557:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856161536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.410612:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856161536:12345-0@lo:400:kworker.0 Request processed in 55us (11513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.410619:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787430834.410635:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787430834.410641:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856161408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.410672:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856161408:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.410678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787430834.410722:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856161408:0@lo:400:kworker.0 00000100:00080000:2.0:1787430834.410763:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430834.417932:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787430834.419478:0:12537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161920 00000100:00100000:1.0:1787430834.419491:0:12537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161920 00000100:00100000:1.0:1787430834.419540:0:12537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787430834.419550:0:12537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1874256856161920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430834.419644:0:12537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1874256856161920:12345-0@lo:400:kworker.0 Request processed in 95us (9231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430834.419651:0:12537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787430834.421341:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856161920:0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.422429:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856161280:0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.422446:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fe04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856161792:0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.422517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430834.422635:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856161792 00000100:00100000:2.0:1787430834.422642:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856161792 00000100:00100000:2.0:1787430834.422689:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787430834.422697:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856161792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430834.422756:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856161792:12345-0@lo:400:kworker.0 Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430834.422762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1787430834.422783:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430834.422798:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fe04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856161792:0@lo:400:kworker.0 00000001:00080000:3.0:1787430834.455881:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:3.0:1787430834.455917:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0f2f7ffee40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787430834.455923:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2d04efc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2f7ffec00 00000020:00080000:3.0:1787430834.455927:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0f2d04efb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0f2fdeb8000 00000020:00080000:3.0:1787430834.455949:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1787430834.455966:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787430834.456528:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787430834.456738:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787430834.468424:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1787430834.468445:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1787430834.468452:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1787430835.228549:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430835.252620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430835.252735:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841507840 00000100:00100000:2.0:1787430835.252749:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841507840 00000100:00100000:2.0:1787430835.252835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 237 00000100:00100000:2.0:1787430835.252848:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11285:x1874256841507840:12345-192.168.204.60@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787430835.252957:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11285:x1874256841507840:12345-192.168.204.60@tcp:60:lhsmtool_posix.0 Request processed in 112us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430835.252964:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 237 00000100:00080000:0.0:1787430835.253222:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430835.256883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430835.256977:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508096 00000100:00100000:3.0:1787430835.256986:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508096 00000100:00100000:3.0:1787430835.257048:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:3.0:1787430835.257072:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:11285:x1874256841508096:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787430835.257844:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:11285:x1874256841508096:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 784us (968us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787430835.257853:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:1.0:1787430835.509252:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430835.516740:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508224 00000100:00100000:3.0:1787430835.516758:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508224 00000100:00100000:3.0:1787430835.517020:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 238 00000100:00100000:3.0:1787430835.517031:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:12083:x1874256841508224:12345-192.168.204.60@tcp:101:lsof.0 00010000:00010000:3.0:1787430835.517775:0:9043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430835.517800:0:9043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14912 expref: -99 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430835.517949:0:9043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69d4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430835.517964:0:9043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69d4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430835.517977:0:9043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69d4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430835.519137:0:9043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787430835.519144:0:9043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430835.519241:0:9043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69d4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430835.519289:0:9043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e69d45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14912 expref: 7 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430835.519310:0:9043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69d4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14912 expref: 6 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430835.519318:0:9043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:3.0:1787430835.519320:0:9043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430835.519323:0:9043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147ae00, rc 0) 00000100:00100000:3.0:1787430835.519518:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:12083:x1874256841508224:12345-192.168.204.60@tcp:101:lsof.0 Request processed in 2486us (10273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430835.519527:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 238 00000100:00080000:0.0:1787430835.523355:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787430836.252506:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430837.275634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430837.275684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430837.275712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430837.275755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430837.275773:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508608 00000100:00100000:2.0:1787430837.275787:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508608 00000100:00100000:0.0:1787430837.275792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430837.275821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508864 00000100:00100000:0.0:1787430837.275825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508864 00000100:00100000:2.0:1787430837.275864:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508736 00000100:00100000:2.0:1787430837.275869:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508736 00000100:00100000:0.0:1787430837.275881:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508480 00000100:00100000:0.0:1787430837.275886:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508480 00000100:00100000:2.0:1787430837.275903:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:2.0:1787430837.275917:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841508608:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430837.275922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:0.0:1787430837.275934:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2373:x1874256841508864:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430837.276025:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2373:x1874256841508608:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 113us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.276034:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:2.0:1787430837.276061:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:2.0:1787430837.276081:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841508736:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430837.276115:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2373:x1874256841508864:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 183us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.276124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:0.0:1787430837.276141:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:0.0:1787430837.276148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c7425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:2373:x1874256841508480:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430837.276185:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c7425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:2373:x1874256841508480:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430837.276191:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00080000:0.0:1787430837.276217:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430837.276223:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430837.276225:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430837.276538:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841508736:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 469us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430837.276546:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:3.0:1787430837.276677:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508352 00000100:00100000:3.0:1787430837.276683:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508352 00000100:00100000:3.0:1787430837.276734:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 285 00000100:00100000:3.0:1787430837.276742:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841508352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430837.276774:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2373:x1874256841508352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430837.276782:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 285 00010000:00010000:0.0:1787430837.277539:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430838.303968:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430838.494890:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787430838.495953:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856162048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430838.496028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430838.496116:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162048 00000100:00100000:2.0:1787430838.496125:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162048 00000100:00100000:2.0:1787430838.496180:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787430838.496190:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856162048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430838.496231:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430838.496641:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856162048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 451us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430838.496649:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787430838.496719:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430838.496840:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856162048:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787430838.989675:0:12777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:33:57 (1787430837) 00010000:00010000:1.0:1787430839.324454:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430839.517393:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856162176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430839.517465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430839.518573:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162176 00000100:00100000:1.0:1787430839.518584:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162176 00000100:00100000:1.0:1787430839.518644:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787430839.518656:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856162176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787430839.518692:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430839.518762:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856162176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430839.518770:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787430839.518793:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430839.518819:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787430839.518824:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2d8275c00, transno 4294967321 00000004:00080000:1.0:1787430839.518836:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2ec153800, transno 4294967322 00000004:00080000:1.0:1787430839.518841:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787430839.519287:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856162176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430839.519409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856162304:0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.519767:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430839.520449:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430839.520458:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856162432:0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.520500:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430839.520539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162304 00000100:00100000:3.0:1787430839.520545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162304 00000100:00100000:3.0:1787430839.520585:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787430839.520595:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856162304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.520643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856162304:12345-0@lo:400:kworker.0 Request processed in 50us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430839.520650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787430839.520687:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162432 00000100:00100000:3.0:1787430839.520690:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162432 00000100:00100000:3.0:1787430839.520724:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787430839.520733:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856162432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.520769:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856162432:12345-0@lo:400:kworker.0 Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430839.520776:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787430839.520817:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856162432:0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.520826:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856162304:0@lo:400:kworker.0 00000100:00100000:1.0:1787430839.524689:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856162688:0@lo:400:kworker.0 00000100:00100000:1.0:1787430839.524758:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430839.524799:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787430839.524806:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856162560:0@lo:400:kworker.0 00000100:00100000:1.0:1787430839.524832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430839.524878:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162688 00000100:00100000:1.0:1787430839.524886:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162688 00000100:00100000:3.0:1787430839.525151:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856162816:0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.525182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430839.525213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162560 00000100:00100000:3.0:1787430839.525218:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162560 00000100:00100000:3.0:1787430839.525259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162816 00000100:00100000:3.0:1787430839.525263:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162816 00000100:00100000:3.0:1787430839.525285:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787430839.525294:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856162560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.525398:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874256856162560:12345-0@lo:400:kworker.0 Request processed in 104us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430839.525405:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787430839.525423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787430839.525928:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787430839.525937:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856162688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430839.525988:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856162688:12345-0@lo:400:kworker.0 Request processed in 53us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430839.525994:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787430839.526169:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856162816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.526216:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874256856162816:12345-0@lo:400:kworker.0 Request processed in 787us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430839.526223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787430839.526244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430839.526407:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1874256856162560:0@lo:400:kworker.0 00000100:00100000:3.0:1787430839.526656:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856162688:0@lo:400:kworker.0 00000100:00100000:1.0:1787430839.526859:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856162816:0@lo:400:kworker.0 00000020:00080000:0.0:1787430839.566501:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1787430839.566529:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787430839.566638:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787430839.566651:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787430840.354453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787430840.413885:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787430840.413895:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787430840.414372:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787430840.414381:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787430841.374051:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430842.396098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.396145:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.396190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.396265:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430842.396582:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841509248 00000100:00100000:1.0:1787430842.396591:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841509248 00000100:00100000:1.0:1787430842.396660:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:1.0:1787430842.396671:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841509248:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430842.396747:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2374:x1874256841509248:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430842.396755:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00010000:00010000:1.0:1787430842.396809:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430842.397523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841509120 00000100:00100000:0.0:1787430842.397529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841509120 00000100:00100000:0.0:1787430842.397574:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841509504 00000100:00100000:0.0:1787430842.397578:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841509504 00000100:00100000:0.0:1787430842.397603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:0.0:1787430842.397611:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:2373:x1874256841509120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430842.397653:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:2373:x1874256841509120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430842.397660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00080000:2.0:1787430842.397818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430842.397823:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430842.401300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:0.0:1787430842.401353:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2374:x1874256841509504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430842.401453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2374:x1874256841509504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 131us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430842.401749:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841508992 00000100:00100000:3.0:1787430842.401758:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841508992 00000100:00100000:3.0:1787430842.401807:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 287 00000100:00100000:3.0:1787430842.401815:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841508992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430842.401844:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2374:x1874256841508992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (5758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430842.401851:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 287 00000100:00100000:3.0:1787430842.401925:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430842.402054:0:12537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841509376 00000100:00100000:3.0:1787430842.402058:0:12537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841509376 00000100:00100000:3.0:1787430842.402093:0:12537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:3.0:1787430842.402100:0:12537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841509376:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430842.402144:0:12537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2373:x1874256841509376:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430842.402150:0:12537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00080000:3.0:1787430842.402169:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430842.411247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:3.0:1787430842.684689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.685171:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841509760 00000100:00100000:2.0:1787430842.685182:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841509760 00000100:00100000:2.0:1787430842.685243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:2.0:1787430842.685254:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+19:12304:x1874256841509760:12345-192.168.204.60@tcp:35:umount.0 00000100:00100000:2.0:1787430842.685867:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:12304:x1874256841509760:12345-192.168.204.60@tcp:35:umount.0 Request processed in 611us (1185us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787430842.685882:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:3.0:1787430842.688631:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.688743:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841510016 00000100:00100000:2.0:1787430842.688754:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841510016 00000100:00100000:2.0:1787430842.688809:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787430842.688820:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+20:12304:x1874256841510016:12345-192.168.204.60@tcp:35:umount.0 00000100:00100000:2.0:1787430842.689387:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:12304:x1874256841510016:12345-192.168.204.60@tcp:35:umount.0 Request processed in 567us (763us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787430842.689395:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:1.0:1787430842.698611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430842.698817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841510272 00000100:00100000:3.0:1787430842.698827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841510272 00000100:00100000:3.0:1787430842.698890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787430842.698901:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f812b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+21:12304:x1874256841510272:12345-192.168.204.60@tcp:35:umount.0 00000100:00100000:3.0:1787430842.699373:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f812b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:12304:x1874256841510272:12345-192.168.204.60@tcp:35:umount.0 Request processed in 472us (769us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787430842.699383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787430842.705621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430842.705809:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841510528 00000100:00100000:0.0:1787430842.705819:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841510528 00000100:00100000:0.0:1787430842.705880:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:0.0:1787430842.705890:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:12304:x1874256841510528:12345-192.168.204.60@tcp:35:umount.0 00000100:00100000:0.0:1787430842.706793:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:12304:x1874256841510528:12345-192.168.204.60@tcp:35:umount.0 Request processed in 900us (1177us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787430842.706803:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:1.0:1787430842.711898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.712466:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841510656 00000100:00100000:2.0:1787430842.712477:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841510656 00000100:00100000:2.0:1787430842.712534:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:2.0:1787430842.712545:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841510656:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430842.712562:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430842.712582:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a200/0x1fa5b1e070e68d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1449d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430842.712604:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430842.712672:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:2371:x1874256841510656:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 128us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430842.712680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:1.0:1787430842.712889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430842.713077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430842.713116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.713293:0:11667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841511168 00000100:00100000:2.0:1787430842.713300:0:11667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841511168 00000100:00100000:3.0:1787430842.713351:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841511296 00000100:00100000:3.0:1787430842.713357:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841511296 00000100:00100000:2.0:1787430842.713364:0:11667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:2.0:1787430842.713375:0:11667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841511168:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430842.713386:0:11667:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787430842.713398:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:3.0:1787430842.713406:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+13:2371:x1874256841511296:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430842.713415:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787430842.713427:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841511040 00010000:00010000:3.0:1787430842.713429:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e68fd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14568 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430842.713433:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841511040 00010000:00010000:3.0:1787430842.713444:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430842.713475:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:3.0:1787430842.713476:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:2371:x1874256841511296:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430842.713486:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:0.0:1787430842.713497:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+7:2370:x1874256841511040:12345-192.168.204.60@tcp:9:umount.0 00000020:00000080:0.0:1787430842.713523:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e692fd 00000020:00010000:0.0:1787430842.713532:0:6683:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0f2c9f17800: total 0 00000100:00080000:0.0:1787430842.713536:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2c9f14800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787430842.713582:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f302044600/0x1fa5b1e070e68d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14465 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787430842.713582:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1787430842.713597:0:11667:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430842.713620:0:11667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2371:x1874256841511168:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 248us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430842.713627:0:11667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00000020:00010000:3.0:1787430842.715695:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0f2c9f17800: total 0 00010000:00010000:3.0:1787430842.715746:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0f2c9f17800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787430842.715800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a89cf74/0x1fa5b1e070e69d3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1490b expref: 5 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430842.715832:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69699 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1473d expref: 4 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430842.715854:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0f2c9f17800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787430842.715865:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430842.715867:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430842.715869:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430842.717297:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711a801a-27eb-4d09-8ae0-8dc5ece71a10+2:2370:x1874256841511040:12345-192.168.204.60@tcp:9:umount.0 Request processed in 3796us (4400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430842.717311:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:1.0:1787430842.725121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430842.725651:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841511424 00000100:00100000:2.0:1787430842.725662:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841511424 00000100:00100000:2.0:1787430842.725717:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:2.0:1787430842.726177:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+5:2370:x1874256841511424:12345-192.168.204.60@tcp:9:umount.0 00000020:00000080:2.0:1787430842.726213:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e69741 00000100:00080000:2.0:1787430842.726224:0:6685:0:(import.c:65:import_set_state_nolock()) ffffa0f2c992a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430842.726267:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1787430842.727640:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430842.727864:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711a801a-27eb-4d09-8ae0-8dc5ece71a10+2:2370:x1874256841511424:12345-192.168.204.60@tcp:9:umount.0 Request processed in 2133us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430842.727876:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:3.0:1787430842.742947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430842.744859:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841512448 00000100:00100000:0.0:1787430842.744875:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841512448 00000100:00100000:0.0:1787430842.745032:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 239 00000100:00100000:0.0:1787430842.745045:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+23:2370:x1874256841512448:12345-192.168.204.60@tcp:39:umount.0 00000020:00000080:0.0:1787430842.745078:0:9043:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68d31 00000020:00010000:0.0:1787430842.745095:0:9043:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0f2ef2f6800: total 0 00000100:00080000:0.0:1787430842.745100:0:9043:0:(import.c:65:import_set_state_nolock()) ffffa0f2ef2f0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430842.745136:0:9043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1787430842.745438:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0f2ef2f6800: total 0 00010000:00010000:1.0:1787430842.745485:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0f2ef2f6800, canceled 0 locks, left on hash table 14. 00000100:00100000:0.0:1787430842.745826:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711a801a-27eb-4d09-8ae0-8dc5ece71a10+22:2370:x1874256841512448:12345-192.168.204.60@tcp:39:umount.0 Request processed in 782us (2886us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787430842.745836:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 239 00010000:00010000:1.0:1787430842.745935:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2d0ce5600) 00010000:00010000:1.0:1787430842.745939:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430842.745947:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5600/0x1fa5b1e070e69017 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1457d expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.745980:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430842.745983:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787430842.745986:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e69cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148f6 expref: 20 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746021:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:1.0:1787430842.746023:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430842.746027:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263e00/0x1fa5b1e070e696fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14759 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746039:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:1.0:1787430842.746042:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430842.746045:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263400/0x1fa5b1e070e6965a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14728 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746055:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430842.746057:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430842.746060:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74400/0x1fa5b1e070e699fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14832 expref: 17 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746072:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430842.746074:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787430842.746077:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74a00/0x1fa5b1e070e69d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14904 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746087:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430842.746089:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787430842.746092:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b800/0x1fa5b1e070e69358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14664 expref: 15 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746102:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0f2d2bc4e00) 00010000:00010000:1.0:1787430842.746104:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430842.746114:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263000/0x1fa5b1e070e68ffb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14576 expref: 14 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746133:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:1.0:1787430842.746135:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787430842.746139:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e69684 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14736 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746151:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0f2d2bc4700) 00010000:00010000:1.0:1787430842.746153:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430842.746157:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263200/0x1fa5b1e070e6957a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc146f0 expref: 12 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746171:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0f2d0ce5c00) 00010000:00010000:1.0:1787430842.746174:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430842.746177:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5c00/0x1fa5b1e070e6906b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14592 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746189:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430842.746192:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430842.746195:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e69c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148be expref: 10 pid: 6884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746207:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0f2d2bc4d00) 00010000:00010000:1.0:1787430842.746209:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787430842.746212:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5200/0x1fa5b1e070e69d1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc148fd expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746226:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0f2d0ce5500) 00010000:00010000:1.0:1787430842.746234:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787430842.746239:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c59a5000/0x1fa5b1e070e69717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14760 expref: 8 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430842.746253:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0f2ef2f6800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787430842.746271:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430842.746272:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430842.746274:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430843.420550:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430843.612869:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856162944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430843.612950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430843.613102:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856162944 00000100:00100000:2.0:1787430843.613120:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856162944 00000100:00100000:2.0:1787430843.613182:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787430843.613193:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856162944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430843.613228:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430843.613275:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856162944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430843.613282:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787430843.613392:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430843.613430:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856162944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430844.397389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430844.397431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430844.397471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430844.397694:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841512704 00000100:00100000:3.0:1787430844.397704:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841512704 00000100:00100000:3.0:1787430844.397764:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841512576 00000100:00100000:3.0:1787430844.397767:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841512576 00000100:00100000:3.0:1787430844.397788:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841512832 00000100:00100000:3.0:1787430844.397791:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841512832 00000100:00100000:3.0:1787430844.397820:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:3.0:1787430844.397834:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+12:2372:x1874256841512704:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430844.397849:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430844.397867:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f30216c000/0x1fa5b1e070e68e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144dc expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430844.397898:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430844.397962:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+11:2372:x1874256841512704:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 132us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430844.397969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:3.0:1787430844.398235:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787430844.398243:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+10:2371:x1874256841512576:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430844.398251:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430844.398260:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e68e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144b2 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430844.398269:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430844.398287:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+9:2371:x1874256841512576:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 46us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430844.398293:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787430844.398306:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:3.0:1787430844.398312:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+8:2371:x1874256841512832:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430844.398320:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430844.398381:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75600/0x1fa5b1e070e68fca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14561 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430844.398391:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430844.398412:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+7:2371:x1874256841512832:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 100us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430844.398419:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:3.0:1787430844.410315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430844.410444:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513088 00000100:00100000:2.0:1787430844.410455:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513088 00000100:00100000:2.0:1787430844.410542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 240 00000100:00100000:2.0:1787430844.410559:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+6:2370:x1874256841513088:12345-192.168.204.60@tcp:39:umount.0 00000020:00000080:2.0:1787430844.410606:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68e18 00000020:00010000:2.0:1787430844.410615:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0f2ec00d800: total 0 00000100:00080000:2.0:1787430844.410619:0:5839:0:(import.c:65:import_set_state_nolock()) ffffa0f2ec009800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787430844.410644:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787430844.410901:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24bdbdfb-c1b7-4700-ba76-999d38d57629+5:2370:x1874256841513088:12345-192.168.204.60@tcp:39:umount.0 Request processed in 343us (596us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787430844.410909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 240 00000020:00010000:2.0:1787430844.410944:0:8454:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0f2ec00d800: total 0 00010000:00010000:2.0:1787430844.410948:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430844.410987:0:8454:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0f2ec00d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787430844.411023:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2d2bc4300) 00010000:00010000:2.0:1787430844.411026:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787430844.411036:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147ae00/0x1fa5b1e070e69d4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14912 expref: 4 pid: 9043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.411061:0:8454:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0f2ec00d800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787430844.411072:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430844.411074:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430844.411075:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430844.413882:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430844.435470:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430844.435562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513344 00000100:00100000:0.0:1787430844.435573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513344 00000100:00100000:0.0:1787430844.435652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 288 00000100:00100000:0.0:1787430844.435664:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+7:2370:x1874256841513344:12345-192.168.204.60@tcp:251:umount.0 00000020:00000080:0.0:1787430844.435713:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68d0e 00000020:00010000:0.0:1787430844.435721:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0f2c622d000: total 0 00000100:00080000:0.0:1787430844.435726:0:5832:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787430844.435809:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1f5d489-c087-4ebd-841c-a9b0d4541e2c+3:2370:x1874256841513344:12345-192.168.204.60@tcp:251:umount.0 Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430844.435831:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 288 00000020:00010000:2.0:1787430844.436054:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0f2c622d000: total 0 00010000:00010000:2.0:1787430844.436105:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0f2c622d000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787430844.436147:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a5400/0x1fa5b1e070e68d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc144a4 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430844.436162:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0f2c622d000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787430844.436171:0:5825:0:(genops.c:885:class_export_put()) final put ffffa0f2c622d000/d1f5d489-c087-4ebd-841c-a9b0d4541e2c 00010000:00010000:2.0:1787430844.436190:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430844.436198:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430844.436200:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787430844.436797:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c622d000/d1f5d489-c087-4ebd-841c-a9b0d4541e2c for MGS 00000020:00000080:0.0:1787430844.436845:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c622f800 for MGS 00010000:00010000:3.0:1787430844.444611:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430844.637995:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856163072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430844.638067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.640910:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856163328:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.640997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.641051:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430844.641059:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856163456:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.641123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163328 00000100:00100000:0.0:1787430844.641130:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163328 00000100:00100000:0.0:1787430844.641166:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163456 00000100:00100000:0.0:1787430844.641169:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163456 00000100:00100000:0.0:1787430844.641201:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787430844.641209:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856163328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641262:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856163328:12345-0@lo:400:kworker.0 Request processed in 54us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430844.641270:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787430844.641286:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787430844.641292:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856163456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856163456:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430844.641324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787430844.641369:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856163200:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641398:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.641421:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856163712:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.641473:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430844.641479:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856163584:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430844.641526:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163712 00000100:00100000:0.0:1787430844.641530:0:6884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163712 00000100:00100000:0.0:1787430844.641553:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787430844.641560:0:6884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856163712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.641593:0:6884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856163712:12345-0@lo:400:kworker.0 Request processed in 33us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430844.641598:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787430844.641648:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856163712:0@lo:400:kworker.0 00000100:00080000:3.0:1787430844.642212:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430844.642226:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163200 00000100:00100000:3.0:1787430844.642231:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163200 00000100:00100000:3.0:1787430844.642260:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787430844.642266:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856163200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430844.642309:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c7ec1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3308:x1874256856163200:12345-0@lo:400:kworker.0 Request processed in 43us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430844.642314:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787430844.642356:0:8633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163584 00000100:00100000:3.0:1787430844.642360:0:8633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163584 00000100:00100000:3.0:1787430844.642385:0:8633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430844.642391:0:8633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430844.642420:0:8633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856163584:12345-0@lo:400:kworker.0 Request processed in 29us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430844.642425:0:8633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787430844.642494:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163072 00000100:00100000:3.0:1787430844.642499:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163072 00000100:00100000:3.0:1787430844.642531:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787430844.642536:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856163072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430844.642562:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430844.642595:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856163072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (4528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430844.642613:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787430844.642627:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430844.645187:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856163584:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.645202:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3308:1874256856163200:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.645261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856163072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430844.645286:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856163456:0@lo:400:kworker.0 00000100:00100000:0.0:1787430844.645296:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c2bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856163328:0@lo:400:kworker.0 00000001:00100000:2.0:1787430844.714137:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:2.0:1787430844.714146:0:7647:0:(genops.c:885:class_export_put()) final put ffffa0f2c9f17800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:0.0:1787430844.714511:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c9f17800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-OST0001 00000020:00000080:0.0:1787430844.714559:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c9f14800 for lustre-OST0001 00000001:00100000:0.0:1787430844.729081:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000001:00080000:0.0:1787430844.729098:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1787430844.729125:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24bdbdfb-c1b7-4700-ba76-999d38d57629 00000001:00080000:0.0:1787430844.729131:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787430844.729148:0:5859:0:(genops.c:885:class_export_put()) final put ffffa0f2ec00d800/24bdbdfb-c1b7-4700-ba76-999d38d57629 00000020:00000080:0.0:1787430844.729170:0:5859:0:(genops.c:885:class_export_put()) final put ffffa0f2ef2f6800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:0.0:1787430844.729186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec00d800/24bdbdfb-c1b7-4700-ba76-999d38d57629 for lustre-MDT0000 00000020:00000080:0.0:1787430844.729235:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ef2f6800/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-MDT0000 00000020:00000080:0.0:1787430844.729264:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2ec009800 for lustre-MDT0000 00000020:00000080:0.0:1787430844.729269:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2ef2f0000 for lustre-MDT0000 00010000:00010000:2.0:1787430845.469678:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787430846.361531:0:12977:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787430846.383469:0:12977:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787430846.383521:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.383538:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.383546:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.383554:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.383581:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787430846.383586:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787430846.383608:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430846.383612:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787430846.383619:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787430846.383649:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0f2c33b1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787430846.386701:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856163840:0@lo:39:umount.0 00000100:00100000:0.0:1787430846.386788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430846.386927:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163840 00000100:00100000:3.0:1787430846.386936:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163840 00000100:00100000:3.0:1787430846.387003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787430846.387015:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874256856163840:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787430846.387048:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68b1d 00000100:00080000:3.0:1787430846.387058:0:5837:0:(import.c:65:import_set_state_nolock()) ffffa0f2c624b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787430846.387272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1874256856163840:12345-0@lo:39:umount.0 Request processed in 259us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430846.387295:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1787430846.387305:0:5837:0:(genops.c:885:class_export_put()) final put ffffa0f2c6249000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787430846.387360:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430846.387368:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.387378:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0031000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430846.387383:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.387391:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430846.387399:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430846.387405:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430846.387408:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787430846.387412:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787430846.387442:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.387448:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430846.387466:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.387473:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031000/0x1fa5b1e070e68dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.387485:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430846.387492:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430846.387495:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.388926:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787430846.391308:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c33b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787430846.391369:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856163840:0@lo:39:umount.0 00000100:00100000:0.0:1787430846.391419:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856163968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.391494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787430846.391719:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430846.391725:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787430846.391729:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787430846.392099:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856163968 00000100:00100000:1.0:1787430846.392108:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856163968 00000100:00100000:1.0:1787430846.392188:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787430846.392198:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856163968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430846.392219:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430846.392243:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0031400/0x1fa5b1e070e68dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68dc4 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.392272:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430846.392352:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:3309:x1874256856163968:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430846.392360:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787430846.392725:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392737:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392745:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392752:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392780:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430846.392788:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392795:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392801:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392807:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392821:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787430846.392848:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430846.392849:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430846.392856:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.392856:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392864:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d000 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:1.0:1787430846.392864:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f302045e00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:3.0:1787430846.392868:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430846.392873:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392877:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.392879:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430846.392884:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430846.392897:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430846.392904:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787430846.392905:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787430846.392906:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787430846.392907:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787430846.392908:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787430846.392928:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.392928:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392934:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430846.392943:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430846.392949:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.392954:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392956:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f30216d000/0x1fa5b1e070e68dd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68dd9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.392961:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f302045e00/0x1fa5b1e070e68cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.392967:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430846.392969:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430846.392971:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.392972:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.392973:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.392974:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430846.392982:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393000:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393006:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393012:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393031:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430846.393037:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393044:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393049:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393055:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393067:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787430846.393070:0:12977:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787430846.393073:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787430846.393093:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430846.393097:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.393109:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430846.393112:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147be00 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:1.0:1787430846.393114:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430846.393116:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.393121:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147b200 already unused, calling callback (ffffffffc1bc6c20) 00010000:00010000:3.0:1787430846.393124:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430846.393124:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787430846.393130:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.393135:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430846.393136:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787430846.393138:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787430846.393140:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:00010000:1.0:1787430846.393141:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430846.393147:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787430846.393149:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787430846.393150:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787430846.393152:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393158:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430846.393164:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393170:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147be00/0x1fa5b1e070e68fb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68fbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.393175:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430846.393179:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430846.393181:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.393181:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787430846.393183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.393187:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430846.393192:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e68a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68a83 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787430846.393196:0:12977:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787430846.393200:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:1.0:1787430846.393203:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430846.393204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787430846.393205:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787430846.393207:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787430846.393210:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787430846.393220:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0f2c346c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430846.393225:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0f1c509e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430846.393231:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa0f2ec2519b8) has exports, disconnecting them 00000020:00080000:3.0:1787430846.393235:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0f2c346c000), last request at 1787430844 00000020:00000080:3.0:1787430846.393242:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c90 00000100:00080000:3.0:1787430846.393260:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0f2c346e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787430846.393314:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0f2c346c000): rc 0 00000020:00000080:3.0:1787430846.393317:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c346c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787430846.393323:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0f1c509e800), last request at 1787430844 00000020:00000080:3.0:1787430846.393355:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68bc5 00000100:00080000:3.0:1787430846.393362:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0f2ed341000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787430846.393373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787430846.393381:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0f1c509e800): rc 0 00000020:00000080:3.0:1787430846.393383:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f1c509e800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787430846.393391:0:12977:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc04f02b53ae0 00000100:00080000:3.0:1787430846.393411:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787430846.393414:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787430846.393423:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787430846.393477:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787430846.393490:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0f2fefae800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787430846.393501:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787430846.393503:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787430846.393509:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1787430846.393554:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430846.393571:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787430846.393579:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787430846.393606:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0f2ec2519b8) has no exports 00000020:00000080:2.0:1787430846.394099:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c6249000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1787430846.396176:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856164480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.396260:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.396352:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856163968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.396378:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430846.396384:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856164096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.396405:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.396437:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856164224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.396462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.396483:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787430846.396488:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856164352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.396507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.396545:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856164608:0@lo:9:umount.0 00000100:00100000:0.0:1787430846.396592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.396612:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856164736:0@lo:9:umount.0 00000100:00100000:0.0:1787430846.396633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430846.396668:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856164480 00000100:00100000:0.0:1787430846.396674:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856164480 00000100:00100000:0.0:1787430846.396723:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856164096 00000100:00100000:0.0:1787430846.396726:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856164096 00000100:00100000:0.0:1787430846.396739:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856164224 00000100:00100000:0.0:1787430846.396742:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856164224 00000100:00100000:0.0:1787430846.396752:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856164352 00000100:00100000:0.0:1787430846.396754:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856164352 00000100:00100000:0.0:1787430846.396769:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430846.396778:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+21:3309:x1874256856164480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430846.396793:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430846.396812:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75200/0x1fa5b1e070e68a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68a7c expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.396832:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430846.396865:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+20:3309:x1874256856164480:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.396872:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787430846.396907:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430846.396913:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+19:3309:x1874256856164096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430846.396922:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430846.396931:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f30216cc00/0x1fa5b1e070e68dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68dd2 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.396941:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430846.396969:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+18:3309:x1874256856164096:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.396976:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787430846.396999:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430846.397005:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+17:3307:x1874256856164224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430846.397013:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430846.397021:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e68ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68cc8 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.397032:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430846.397059:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+16:3307:x1874256856164224:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.397065:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430846.397099:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430846.397105:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+15:3307:x1874256856164352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430846.397111:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430846.397119:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f30216ce00/0x1fa5b1e070e68fbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68fb5 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.397127:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430846.397148:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:839a7a74-1b4a-4cd3-9548-e5ffe194716c+14:3307:x1874256856164352:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.397154:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787430846.397177:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856164608 00000100:00100000:0.0:1787430846.397181:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856164608 00000100:00100000:0.0:1787430846.397217:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856164736 00000100:00100000:0.0:1787430846.397220:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856164736 00000100:00100000:0.0:1787430846.397237:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430846.397243:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874256856164608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787430846.397270:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c12 00000100:00080000:0.0:1787430846.397278:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f1c4dea000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430846.397313:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787430846.397513:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1874256856164608:12345-0@lo:9:umount.0 Request processed in 269us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.397519:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787430846.397531:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787430846.397537:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874256856164736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787430846.397548:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68cf9 00000100:00080000:0.0:1787430846.397553:0:6683:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe471800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787430846.397574:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787430846.397815:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1874256856164736:12345-0@lo:9:umount.0 Request processed in 277us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430846.397821:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787430846.397843:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787430846.397846:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787430846.397856:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430846.397908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856164352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.397919:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3307:1874256856164224:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787430846.397950:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2fefae800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787430846.397961:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787430846.397963:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430846.397966:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856164608:0@lo:9:umount.0 00000100:00080000:0.0:1787430846.397977:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787430846.397993:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787430846.397995:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430846.397998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856164736:0@lo:9:umount.0 00010000:00010000:0.0:1787430846.398026:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430846.398042:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856164096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430846.398051:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856164480:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787430846.400373:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c346c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787430846.400439:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f1c509e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787430846.400469:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c624b800 for lustre-MDT0000 00000020:00000080:2.0:1787430846.400475:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c346e800 for lustre-MDT0000 00000020:00000080:2.0:1787430846.400478:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2ed341000 for lustre-MDT0000 00000020:00080000:3.0:1787430846.411523:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0f2ec2519b8) has no exports 00010000:00010000:1.0:1787430846.492556:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787430846.500587:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68ad7 00000020:00000080:3.0:1787430846.500620:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ed344000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787430846.500687:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787430846.503695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ed344000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787430846.503749:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430846.503761:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787430846.503766:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa0f2ed32cd28) has no exports 00000020:00000080:2.0:1787430846.504103:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68ad0 00000020:00000080:2.0:1787430846.504113:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ed326000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787430846.504777:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ed326000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787430846.504919:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430846.504928:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787430846.504932:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ed320800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787430846.504935:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ed320800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787430846.504939:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787430846.505291:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f2fe097660 - data ffffa0f1c4ac0a20/ffffa0f2fe77cc00 00000020:01000000:2.0:1787430846.505502:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f301700ba0 - data ffffa0f2faafe1b0/ffffa0f2c3455c00 00000001:00000004:2.0:1787430846.521654:0:12977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787430846.641542:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787430846.641551:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787430846.641575:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430846.641578:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787430846.646555:0:6882:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787430846.646564:0:6882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787430846.646578:0:6882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787430846.647662:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787430846.647669:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787430846.647690:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430846.647693:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787430846.648469:0:8168:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787430846.648474:0:8168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787430846.648496:0:8168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:0.0:1787430846.720187:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787430846.720197:0:6708:0:(genops.c:885:class_export_put()) final put ffffa0f1c4dea800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787430846.720220:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:0.0:1787430846.720222:0:6708:0:(genops.c:885:class_export_put()) final put ffffa0f2c992f000/711a801a-27eb-4d09-8ae0-8dc5ece71a10 00000020:00000080:1.0:1787430846.721095:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f1c4dea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787430846.721141:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c992f000/711a801a-27eb-4d09-8ae0-8dc5ece71a10 for lustre-OST0000 00000020:00000080:1.0:1787430846.721161:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f1c4dea000 for lustre-OST0000 00000020:00000080:1.0:1787430846.721165:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c992a800 for lustre-OST0000 00000020:00000080:0.0:1787430846.737899:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68a9f 00000020:00000080:0.0:1787430846.737913:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ec24e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787430846.739296:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68ab4 00000020:00000080:0.0:1787430846.739306:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ec268000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787430846.739313:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787430846.739318:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430846.739351:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787430846.739355:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa0f2ec250000) has no exports 00000004:01000000:0.0:1787430846.739508:0:12977:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787430846.739516:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68cf2 00000020:00000080:0.0:1787430846.739521:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c33b3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787430846.739525:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787430846.739529:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430846.739535:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787430846.739546:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffffa0f2ed328000) has no exports 00000020:00000080:0.0:1787430846.739552:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68ceb 00000020:00000080:0.0:1787430846.739556:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c622c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787430846.740284:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec24e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787430846.740305:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec268000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787430846.740311:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c33b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787430846.740319:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c622c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787430846.740412:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787430846.740417:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787430846.740422:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787430846.740427:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430846.740430:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787430846.740477:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430846.740487:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430846.740492:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c0b 00000020:00000080:0.0:1787430846.740499:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2fefab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787430846.740504:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787430846.740508:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430846.740512:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787430846.740515:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa0f2c3ec99b8) has no exports 00000020:00000080:0.0:1787430846.740519:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c04 00000020:00000080:0.0:1787430846.740523:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2fefaa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787430846.740635:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c622c000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787430846.740643:0:471:0:(genops.c:885:class_export_put()) final put ffffa0f2c622b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787430846.740646:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c622b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787430846.740808:0:471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787430846.740895:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fefab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787430846.740902:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fefaa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787430846.740924:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787430846.740927:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787430846.740929:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787430846.740933:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787430846.740935:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787430846.740968:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430846.740973:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430846.741000:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430846.741003:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430846.741006:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ec24f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787430846.741009:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec24f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787430846.741012:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430846.741132:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68abb 00000020:00000080:0.0:1787430846.741145:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ec268800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787430846.741149:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787430846.741151:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430846.741155:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787430846.741158:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa0f2ec254d28) has no exports 00000020:00000080:3.0:1787430846.741165:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2fefae800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787430846.741172:0:471:0:(genops.c:885:class_export_put()) final put ffffa0f2ef2f4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787430846.741175:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ef2f4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787430846.741179:0:471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787430846.741181:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430846.741186:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787430846.741351:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68ac2 00000020:00000080:0.0:1787430846.741357:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ec26f800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787430846.741371:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f2d0492800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787430846.741374:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2d0492800 3 00000020:01000004:0.0:1787430846.741377:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0f2d0492800 from lustre-MDT0000 00000020:00000080:3.0:1787430846.741387:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec268800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787430846.741392:0:471:0:(genops.c:885:class_export_put()) final put ffffa0f2ec249000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787430846.741394:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec249000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787430846.741401:0:471:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787430846.741405:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430846.741409:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787430846.741412:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2ec24a000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787430846.741415:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec24a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787430846.741427:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787430846.741466:0:12977:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787430846.741470:0:12977:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787430846.741473:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787430846.741477:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430846.741479:0:12977:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787430846.741486:0:12977:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa0f2c97ce800 839a7a74-1b4a-4cd3-9548-e5ffe194716c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787430846.741492:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa0f2c7f58000) has exports, disconnecting them 00000020:00080000:0.0:1787430846.741496:0:12977:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0f2c97ce800), last request at 1787430670 00000020:00000080:0.0:1787430846.741509:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68a60 00000020:00010000:0.0:1787430846.741514:0:12977:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0f2c97ce800: total 2 00000100:00080000:0.0:1787430846.741518:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0f2c97ce000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787430846.741533:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0f2c97ce800): rc 0 00000020:00080000:0.0:1787430846.741538:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa0f2c7f58000) has no exports 00000020:00010000:0.0:1787430846.741551:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0f2c97ce800: total 2 00010000:00010000:0.0:1787430846.741578:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0f2c97ce800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787430846.741615:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0030600/0x1fa5b1e070e68b78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68b71 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787430846.741629:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2ec26f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787430846.741638:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4e00/0x1fa5b1e070e68df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68dee expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741652:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c0030a00/0x1fa5b1e070e68d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68d7e expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741663:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e68da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68d9a expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741676:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f30216ca00/0x1fa5b1e070e68fa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68f99 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741688:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a5a00/0x1fa5b1e070e68daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68da8 expref: 4 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741699:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4600/0x1fa5b1e070e68fae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68fa7 expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741710:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a5800/0x1fa5b1e070e68d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1fa5b1e070e68d70 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430846.741720:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0f2c97ce800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787430846.741731:0:5826:0:(genops.c:885:class_export_put()) final put ffffa0f2c97ce800/839a7a74-1b4a-4cd3-9548-e5ffe194716c 00010000:00010000:0.0:1787430846.741749:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430846.741751:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430846.741753:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787430846.742286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c97ce800/839a7a74-1b4a-4cd3-9548-e5ffe194716c for MGS 00000020:00000080:1.0:1787430846.742357:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c97ce000 for MGS 00000100:00100000:3.0:1787430846.742438:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0f2c2e74000:5830] 0 exiting: rc = 1 00000100:00100000:3.0:1787430846.742541:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa0f2c6321200:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1787430846.742589:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0f2c6321600:5832] 2 exiting: rc = 0 00000100:00100000:0.0:1787430846.742675:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742684:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742697:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742702:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742708:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742714:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742719:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742727:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742732:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742738:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742744:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742750:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742754:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742771:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742778:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742784:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742790:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742796:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742802:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742807:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742951:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742958:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742964:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742970:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742976:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742982:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742988:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742993:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.742998:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743005:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743010:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743015:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743021:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743025:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743031:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743036:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743041:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743058:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743063:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743069:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743074:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743079:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743084:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743090:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743095:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743100:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743106:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743111:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743116:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743120:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743126:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743131:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743137:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743143:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743148:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743154:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743160:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743164:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743169:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743174:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743179:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743184:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743189:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.743194:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787430846.743646:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787430846.743649:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787430846.744751:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f1c698e300 - data ffffa0f2e53dc0d8/ffffa0f2fe904000 00000020:01000000:0.0:1787430846.744909:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f2c67eb480 - data ffffa0f2fabd8870/ffffa0f2c2fccc00 00000020:00000080:0.0:1787430846.745381:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68a44 00000020:00000080:0.0:1787430846.745389:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2d8663800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787430846.745412:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f2d0492800 from MGS, refs=2 00000020:01000004:0.0:1787430846.745425:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2d0492800 2 00000020:01000004:0.0:1787430846.745429:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0f2d0492800 from MGS 00000020:00000080:0.0:1787430846.745451:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430846.745457:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787430846.745460:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2d8a35800/MGS 00000020:00000080:0.0:1787430846.745463:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2d8a35800/MGS for MGS 00000020:01000000:0.0:1787430846.745469:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1787430846.745492:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2d8663800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787430846.745522:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787430846.745527:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430846.745533:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787430846.745540:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0f2c33b1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787430846.745546:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffffa0f2c345cd28) has exports, disconnecting them 00000020:00080000:0.0:1787430846.745550:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0f2c33b1800), last request at 1787430670 00000020:00000080:0.0:1787430846.745554:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68b0f 00000020:00080000:0.0:1787430846.745564:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0f2c33b1800): rc 0 00000020:00000080:0.0:1787430846.745568:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c33b1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787430846.745602:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c33b1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787430846.763227:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787430846.763236:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787430846.763241:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787430846.763249:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787430846.763560:0:471:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c33b1000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787430846.763621:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787430846.763629:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787430846.763634:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c33b0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787430846.763638:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c33b0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787430846.763647:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787430846.763708:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2d0492800 1 00000020:00000080:1.0:1787430846.763715:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68a36 00000020:00000080:1.0:1787430846.763721:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c62b8000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787430846.763738:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787430846.763742:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787430846.763746:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787430846.763750:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa0f2c345b370) has no exports 00000020:00000080:3.0:1787430846.764181:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c62b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787430846.810835:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430846.810848:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787430846.810853:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2d8a30800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787430846.810858:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2d8a30800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787430846.810867:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787430846.811020:0:12977:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0f2d0493000 00000020:01000000:3.0:1787430846.811040:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787430846.811044:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430846.811048:0:12977:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787430846.811052:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa0f2c34599b8) has no exports 00000100:00100000:3.0:1787430846.811129:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa0f2d1173400:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1787430846.811228:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0f2d4c02400:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1787430846.811361:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0f2d1173200:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1787430846.811429:0:9043:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa0f2c2ff0a00:9043] 4 exiting: rc = 0 00000100:00100000:1.0:1787430846.811842:0:6884:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa0f2c62a3800:6884] 3 exiting: rc = 0 00000100:00100000:3.0:1787430846.812205:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812214:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812220:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812226:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812243:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812250:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812256:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812271:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812279:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812285:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812291:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812297:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812302:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812307:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812313:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812318:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812323:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812354:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812361:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812367:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812383:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812389:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812394:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812400:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812411:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812418:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812424:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812429:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812434:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812440:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812445:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812451:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812456:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812461:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812467:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812472:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812478:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812483:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812488:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812495:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812501:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812508:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812513:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812520:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812526:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812531:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812537:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812542:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812547:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812553:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812558:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812563:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812569:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812574:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812580:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812594:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812599:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812605:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812610:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812616:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812621:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812627:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812633:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.812639:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.825729:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa0f2d1173600:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1787430846.825904:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa0f2d1172a00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1787430846.826018:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826027:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826034:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826042:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826047:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826053:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826059:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826065:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826071:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826076:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826097:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826103:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826109:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826114:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826119:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826124:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826128:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826133:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826139:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826144:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826149:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826154:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826159:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826164:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826169:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826173:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826178:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826183:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826188:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826193:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826199:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826204:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826208:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826212:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826217:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826222:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826227:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826232:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826238:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826243:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826248:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826253:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826257:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826262:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826267:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826280:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826285:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826290:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826296:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826301:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826307:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826313:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826318:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826323:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826471:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826477:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826483:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826488:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826493:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826499:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826504:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826510:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826514:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.826519:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.827011:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa0f2f8168200:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787430846.827104:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa0f2f8169000:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1787430846.827553:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827561:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827566:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827571:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827577:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827582:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827587:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827592:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827597:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827603:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827608:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827614:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827631:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827638:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827643:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827649:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827663:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827669:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827675:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827681:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827686:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827692:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827697:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827703:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827720:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827726:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827732:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827738:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827743:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827749:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827756:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827763:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827769:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827775:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827780:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827785:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827806:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827813:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827819:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827825:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827831:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827836:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827842:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827848:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827853:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827858:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827864:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827871:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827903:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827909:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827915:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827928:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827933:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827940:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827950:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827956:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827961:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827967:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827974:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.827980:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.828002:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.828011:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.828017:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.828022:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.840849:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa0f2f8169800:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1787430846.840985:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa0f301764600:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1787430846.841147:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841155:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841161:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841166:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841172:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841178:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841184:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841190:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841194:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841199:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841204:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841209:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841214:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841219:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841225:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841294:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841301:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841307:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841312:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841317:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841322:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841447:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841466:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841471:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841476:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841481:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841486:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841491:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841496:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841501:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841506:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841511:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841516:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841521:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841527:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841532:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841538:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841543:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841548:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841553:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841559:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841564:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841569:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841574:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841579:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841584:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841589:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841594:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841599:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841604:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841609:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841614:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841619:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841624:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841630:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841634:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841639:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841652:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841656:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841661:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841666:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841671:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841676:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.841681:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.842199:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa0f301765800:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1787430846.842512:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa0f301764800:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1787430846.842622:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842629:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842634:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842639:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842643:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842648:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842664:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842669:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842674:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842678:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842682:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842687:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842691:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842695:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842700:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842704:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842709:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842713:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842717:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842721:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842725:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842729:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842733:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842737:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842741:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842745:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842750:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842755:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842760:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842765:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842770:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842775:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842781:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842785:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842791:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842796:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842801:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842807:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842811:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842816:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842820:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842833:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842838:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842843:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842848:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842853:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842858:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842863:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842868:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842873:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842890:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842895:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842901:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842906:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842911:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842917:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842922:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842928:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842933:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842938:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842943:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842947:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842952:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.842957:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430846.843453:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa0f301765600:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1787430846.843594:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0f301764400:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1787430846.843697:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843705:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843710:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843716:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843721:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843726:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843732:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843737:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843742:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843747:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843753:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843759:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843777:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843782:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843786:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843792:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843797:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843802:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843807:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843813:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843818:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843824:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843829:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843834:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843839:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843844:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843849:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843854:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843859:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843864:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843869:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843874:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843891:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843896:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843901:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843906:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843911:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843917:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843922:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843927:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843932:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843937:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843942:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843947:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843952:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843958:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843963:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843974:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843979:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843984:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843989:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843994:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.843998:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844003:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844007:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844012:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844016:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844021:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844026:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844031:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844036:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844041:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844048:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430846.844053:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.844747:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa0f2c66efc00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787430846.844955:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa0f2c66efe00:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1787430846.848687:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa0f2c66eec00:5852] 2 exiting: rc = 0 00000100:00100000:3.0:1787430846.848908:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848917:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848922:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848927:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848935:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848940:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848947:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848952:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848959:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848964:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848970:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848976:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848982:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848988:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848994:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.848998:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849003:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849008:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849014:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849019:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849043:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849050:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849058:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849065:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849073:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849080:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849088:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849097:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849103:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849112:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849144:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849154:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849162:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849169:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849179:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849186:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849194:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849202:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849211:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849220:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849228:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849239:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849251:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849261:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849268:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849275:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849281:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849353:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849364:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849370:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849376:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849382:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849387:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849393:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849415:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849426:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849431:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849437:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849442:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849447:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849453:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849458:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849464:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430846.849477:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787430846.859177:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430846.859190:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787430846.859195:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0f2c3480000/MDS_uuid 00000020:00000080:3.0:1787430846.859200:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c3480000/MDS_uuid for MDS 00000020:01000000:3.0:1787430846.859206:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787430846.859469:0:12977:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787430847.521202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430848.540457:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430849.574289:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430849.758493:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430849.758515:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856164864:0@lo:400:kworker.0 00000400:00000100:3.0:1787430849.758568:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256856164864 offset 0 length 224: 4 00000100:00100000:3.0:1787430849.758628:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856164992:0@lo:400:kworker.0 00000400:00000100:3.0:1787430849.758648:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856164992 offset 0 length 224: 4 00000100:00100000:3.0:1787430849.758662:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787430849.758667:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856165120:0@lo:400:kworker.0 00000400:00000100:3.0:1787430849.758683:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856165120 offset 0 length 224: 4 00000001:00100000:1.0:1787430849.869041:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787430849.869050:0:7647:0:(genops.c:885:class_export_put()) final put ffffa0f2fe473000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787430849.869190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fe473000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787430849.869247:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2fe471800 for lustre-OST0001 00000020:01000004:3.0:1787430850.577266:0:13127:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787430850.592471:0:13127:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787430850.592528:0:13127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430850.592543:0:13127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430850.592565:0:13127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430850.592572:0:13127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430850.592592:0:13127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787430850.592597:0:13127:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787430850.592620:0:13127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430850.592632:0:13127:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c4c9bb80 x1874256856164992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787430850.592652:0:13127:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787430850.592658:0:13127:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787430850.592683:0:13127:0:(import.c:65:import_set_state_nolock()) ffffa0f1c509c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787430850.592818:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430850.592825:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430850.592833:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0030000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430850.592837:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430850.592845:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430850.592852:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430850.592858:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430850.592860:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787430850.592863:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787430850.592886:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430850.592901:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430850.592925:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430850.592932:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030000/0x1fa5b1e070e68d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1fa5b1e070e68da1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430850.592943:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430850.592944:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430850.592946:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430850.592959:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1874256856165248:0@lo:39:umount.0 00000400:00000100:0.0:1787430850.593019:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856165248 offset 0 length 224: 4 00000100:00100000:2.0:1787430850.593740:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856164992:0@lo:400:kworker.0 00000100:00100000:2.0:1787430850.593768:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430850.593778:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856165376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430850.593834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430850.593885:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856165376 00000100:00100000:2.0:1787430850.593891:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856165376 00000100:00100000:2.0:1787430850.593924:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787430850.593931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1874256856165376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787430850.593937:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787430850 with bad export cookie 2280424363857971808 00010000:00010000:0.0:1787430850.595169:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430850.621286:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1874256856165376:12345-0@lo:103:ldlm_bl.0 Request processed in 27344us (27442us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787430850.621300:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787430850.629200:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787430850.629208:0:3310:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3484800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787430850.629213:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787430850.650556:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787430850.650563:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787430850.650572:0:3310:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c4c9b100 x1874256856164864/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787430865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430850.650606:0:3310:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f2c35ff100 x1874256856165376/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787430866 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787430850.650616:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787430850.650618:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787430850.650620:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787430850.650623:0:3310:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3484800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787430850.650628:0:3310:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 133 00000100:00080000:0.0:1787430850.650655:0:3310:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffffa0f2c3484800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787430850.652515:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c6ee0000 x1874256856165504/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430850.652579:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3310:1874256856165376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430850.656108:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3309:1874256856164864:0@lo:400:kworker.0 00000100:00100000:2.0:1787430850.656575:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3306:1874256856165504:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787430850.656625:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256856165504 offset 0 length 520: 4 00010000:00010000:0.0:1787430851.612849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430852.638088:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430853.660617:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430854.686289:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430854.876859:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430854.876870:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430854.877031:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787430854.877053:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856165632:0@lo:400:kworker.0 00000400:00000100:3.0:1787430854.877109:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856165632 offset 0 length 224: 4 00010000:00010000:0.0:1787430855.711298:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430855.900493:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430855.900504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787430855.900663:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787430855.900686:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856165760:0@lo:400:kworker.0 00000400:00000100:3.0:1787430855.900757:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856165760 offset 0 length 224: 4 00010000:00010000:0.0:1787430856.736181:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430857.757296:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430858.781770:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430859.807204:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430860.828557:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787430861.020466:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787430861.020476:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787430861.020523:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430850/real 1787430850] req@ffffa0f1c6ee0000 x1874256856165504/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787430860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430861.020552:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c6ee0000 x1874256856165504/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787430860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430861.020562:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430850/real 1787430850] req@ffffa0f1c4c99880 x1874256856165248/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430861.020576:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c4c99880 x1874256856165248/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430861.020593:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3484800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430861.020621:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787430861.020625:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3306:1874256856165504:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1787430861.020631:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f1c509c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787430861.020640:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1874256856165248:0@lo:39:umount.0 00000100:00100000:1.0:1787430861.020683:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856165888:0@lo:400:kworker.0 00000400:00000100:1.0:1787430861.020730:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856165888 offset 0 length 224: 4 00000100:00080000:3.0:1787430861.020852:0:13127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787430861.020862:0:13127:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787430861.020867:0:13127:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787430861.020881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430861.020885:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787430861.020887:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3484800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787430861.020892:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 314 00000100:00080000:2.0:1787430861.020897:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787430861.020903:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffffa0f2c3484800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787430861.020920:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c10b9c00 x1874256856166016/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430861.021058:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3306:1874256856166016:0@lo:250:kworker.0 00000400:00000100:1.0:1787430861.021079:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874256856166016 offset 0 length 520: 4 00010000:00010000:3.0:1787430861.022103:0:13127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022119:0:13127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022126:0:13127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022133:0:13127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022158:0:13127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787430861.022165:0:13127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022171:0:13127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022177:0:13127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022182:0:13127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430861.022245:0:13127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787430861.022251:0:13127:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787430861.022271:0:13127:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787430861.022275:0:13127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787430861.022288:0:13127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787430861.022303:0:13127:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787430861.022308:0:13127:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0f2fe368000) has no exports 00000020:00080000:3.0:1787430861.022350:0:13127:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0f2fe368000) has no exports 00010000:00010000:1.0:1787430861.025409:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430861.025424:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025435:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0030800 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430861.025439:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025451:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430861.025458:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430861.025464:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787430861.025467:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787430861.025470:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787430861.025493:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:1.0:1787430861.025497:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025514:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0030800/0x1fa5b1e070e68da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68daf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025530:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430861.025534:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025559:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d600 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430861.025563:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025570:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430861.025576:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430861.025582:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787430861.025585:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787430861.025587:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787430861.025593:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:1.0:1787430861.025596:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025617:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f30216d600/0x1fa5b1e070e68fa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68fae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430861.025627:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430861.025629:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430861.025631:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787430861.026907:0:13127:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f2c59fa5a0 - data ffffa0f2e52f5af8/ffffa0f2fdf04400 00000020:01000000:3.0:1787430861.027096:0:13127:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f2c32fc180 - data ffffa0f2fab28870/ffffa0f1c503c000 00010000:00010000:0.0:1787430861.029179:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787430861.041370:0:13127:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787430861.077686:0:13127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68b94 00000020:00000080:3.0:1787430861.077696:0:13127:0:(genops.c:885:class_export_put()) final put ffffa0f1c4dee000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787430861.077716:0:13127:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f2c562b800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787430861.077719:0:13127:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2c562b800 2 00000020:01000004:3.0:1787430861.077723:0:13127:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0f2c562b800 from lustre-OST0000 00000020:00000080:3.0:1787430861.077745:0:13127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787430861.077754:0:13127:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787430861.077756:0:13127:0:(genops.c:885:class_export_put()) final put ffffa0f1c4dec800/lustre-OST0000_UUID 00000020:00000080:3.0:1787430861.077759:0:13127:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f1c4dec800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787430861.077765:0:13127:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787430861.077801:0:13127:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787430861.077805:0:13127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787430861.077809:0:13127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787430861.077811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f1c4dee000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787430861.077813:0:13127:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787430861.077819:0:13127:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0f1c509a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787430861.077825:0:13127:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffffa0f2ed32b370) has exports, disconnecting them 00000020:00080000:3.0:1787430861.077830:0:13127:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0f1c509a000), last request at 1787430682 00000020:00000080:3.0:1787430861.077835:0:13127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68bbe 00000020:00080000:3.0:1787430861.077844:0:13127:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0f1c509a000): rc 0 00000020:00000080:3.0:1787430861.077848:0:13127:0:(genops.c:885:class_export_put()) final put ffffa0f1c509a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787430861.077903:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f1c509a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787430861.081930:0:13127:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787430861.081940:0:13127:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787430861.081955:0:13127:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787430861.081963:0:13127:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787430861.082166:0:13127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430861.082175:0:13127:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787430861.082181:0:13127:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2c562b800 1 00000020:00000080:0.0:1787430861.082188:0:13127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68b4e 00000020:00000080:0.0:1787430861.082196:0:13127:0:(genops.c:885:class_export_put()) final put ffffa0f2c5628800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787430861.082201:0:13127:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787430861.082206:0:13127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430861.082210:0:13127:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787430861.082214:0:13127:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa0f2ec253370) has no exports 00000020:00000080:1.0:1787430861.083898:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f1c509c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787430861.083911:0:36:0:(genops.c:885:class_export_put()) final put ffffa0f1c509f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787430861.083914:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f1c509f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787430861.083931:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787430861.083999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c5628800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787430861.115107:0:13127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787430861.115123:0:13127:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787430861.115128:0:13127:0:(genops.c:885:class_export_put()) final put ffffa0f2c562a800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787430861.115132:0:13127:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c562a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787430861.115142:0:13127:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787430861.115274:0:13127:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0f2c562e800 00000020:02000400:1.0:1787430861.115349:0:13127:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787430861.860893:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430862.879669:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787430863.541748:0:13278:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787430863.555639:0:13278:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787430863.555715:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430863.555826:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430863.555835:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430863.555842:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430863.555867:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787430863.555872:0:13278:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787430863.555893:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430863.555903:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c4c9a300 x1874256856165120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430863.555922:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c6ee1f80 x1874256856165632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430870 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430863.555953:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c6ee3100 x1874256856165760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430863.555966:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c4c9b100 x1874256856165888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430863.555974:0:13278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787430863.555980:0:13278:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787430863.556003:0:13278:0:(import.c:65:import_set_state_nolock()) ffffa0f2d0495800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787430863.556067:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430863.556074:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430863.556082:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c0031e00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430863.556091:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430863.556101:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430863.556108:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430863.556204:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856165120:0@lo:400:kworker.0 10000000:01000000:0.0:1787430863.556252:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430863.556255:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787430863.556258:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787430863.556271:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:0.0:1787430863.556275:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430863.556282:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c0031e00/0x1fa5b1e070e68d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430863.556293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430863.556295:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430863.556297:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430863.556371:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1874256856165632:0@lo:400:kworker.0 00000100:00100000:1.0:1787430863.556396:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856165888:0@lo:400:kworker.0 00000100:00100000:1.0:1787430863.556402:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856165760:0@lo:400:kworker.0 00000100:00100000:1.0:1787430863.556611:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1874256856166144:0@lo:39:umount.0 00000400:00000100:1.0:1787430863.556656:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874256856166144 offset 0 length 224: 4 00010000:00010000:0.0:1787430863.900562:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430864.924554:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430865.948641:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787430866.141559:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787430866.141569:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787430866.972844:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430867.997758:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430869.020683:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430870.044621:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430871.069053:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787430871.260544:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787430871.260554:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787430872.094600:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430873.116672:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430873.756463:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430863/real 1787430863] req@ffffa0f1c10b8e00 x1874256856166144/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430873 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430873.756495:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c10b8e00 x1874256856166144/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787430873 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787430873.756513:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2d0495800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787430873.756581:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1874256856166144:0@lo:39:umount.0 00000100:00080000:2.0:1787430873.757937:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787430873.757945:0:13278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787430873.757952:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787430873.760669:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760688:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760695:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760701:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760751:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430873.760760:0:13278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760767:0:13278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760774:0:13278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760780:0:13278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430873.760803:0:13278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787430873.760808:0:13278:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787430873.760832:0:13278:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787430873.760836:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787430873.760840:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430873.760845:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787430873.760850:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa0f2fe3699b8) has no exports 00000020:00080000:2.0:1787430873.760874:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa0f2fe3699b8) has no exports 00010000:00010000:1.0:1787430873.761186:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430873.761201:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761210:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4200 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430873.761214:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761223:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430873.761229:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430873.761235:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787430873.761238:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787430873.761240:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787430873.761254:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:1.0:1787430873.761258:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761264:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4200/0x1fa5b1e070e68d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68d85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761279:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430873.761282:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761287:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a000 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430873.761290:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761304:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430873.761309:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430873.761314:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787430873.761316:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787430873.761318:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787430873.761322:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:1.0:1787430873.761377:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761384:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a000/0x1fa5b1e070e68f99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68fa0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430873.761397:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430873.761399:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430873.761401:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430873.761988:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787430873.764654:0:13278:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f2c59fa960 - data ffffa0f2fab64a20/ffffa0f2fdf06c00 00000020:01000000:2.0:1787430873.764920:0:13278:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0f2c56b0120 - data ffffa0f2e532d288/ffffa0f1c4ca4000 00100000:10000000:2.0:1787430873.771071:0:13278:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787430873.831933:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c5f 00000020:00000080:0.0:1787430873.831955:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2fe93a000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787430873.831980:0:13278:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f1c4de8800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787430873.831984:0:13278:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f1c4de8800 2 00000020:01000004:0.0:1787430873.831987:0:13278:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0f1c4de8800 from lustre-OST0001 00000020:00000080:2.0:1787430873.832000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fe93a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787430873.832018:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430873.832030:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787430873.832033:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2fe938000/lustre-OST0001_UUID 00000020:00000080:0.0:1787430873.832035:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fe938000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787430873.832048:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787430873.832635:0:13278:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 839a7a74-1b4a-4cd3-9548-e5ffe194716c->MGS 00010000:00010000:0.0:1787430873.832812:0:13278:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430873.832857:0:13278:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430873.832863:0:13278:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787430873.832866:0:13278:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787430873.832869:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787430873.832886:0:13278:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:0.0:1787430873.832890:0:13278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75a00/0x1fa5b1e070e68b71 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68b78 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430873.832908:0:13278:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430873.832915:0:13278:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430873.832919:0:13278:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787430873.832921:0:13278:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787430873.832923:0:13278:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787430873.832941:0:13278:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0f2c3484800 00010000:00010000:0.0:1787430873.832944:0:13278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e68dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1fa5b1e070e68df5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787430873.832962:0:13278:0:(import.c:65:import_set_state_nolock()) ffffa0f2c3484800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787430873.832966:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787430873.832969:0:13278:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787430873.832971:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787430873.832976:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787430873.832993:0:13278:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0f1c10b9c00 x1874256856166016/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787430876 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787430873.833005:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787430873.833008:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1787430873.833092:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:839a7a74-1b4a-4cd3-9548-e5ffe194716c:3306:1874256856166016:0@lo:250:kworker.0 10000000:01000000:0.0:1787430873.833224:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787430873.833232:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68a52 00000020:00000080:0.0:1787430873.833240:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2c3483800/839a7a74-1b4a-4cd3-9548-e5ffe194716c 00000020:01000000:0.0:1787430873.833261:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.160@tcp (flags='') 00000020:00000080:0.0:1787430873.833267:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430873.833273:0:13278:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787430873.833277:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa0f2c3458000) has no exports 10000000:01000000:1.0:1787430873.833455:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1787430873.833678:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c3483800/839a7a74-1b4a-4cd3-9548-e5ffe194716c for MGC192.168.204.160@tcp 10000000:01000000:0.0:1787430873.833877:0:13278:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.160@tcp: client import never connected 00000100:00080000:0.0:1787430873.833881:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787430873.833884:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787430873.833886:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787430873.833888:0:13278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787430873.833941:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787430873.833949:0:13278:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.160@tcp (uuid 839a7a74-1b4a-4cd3-9548-e5ffe194716c) 00000020:01000000:0.0:1787430873.833955:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787430873.833960:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787430873.833964:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787430873.833969:0:13278:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa0f2fefaf000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787430873.833974:0:13278:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffffa0f2fe36cd28) has exports, disconnecting them 00000020:00080000:0.0:1787430873.833986:0:13278:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa0f2fefaf000), last request at 1787430694 00000020:00000080:0.0:1787430873.833991:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c89 00000020:00080000:0.0:1787430873.834006:0:13278:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0f2fefaf000): rc 0 00000020:00000080:0.0:1787430873.834010:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2fefaf000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787430873.835246:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2c3484800 for MGC192.168.204.160@tcp 00000020:00000080:2.0:1787430873.835260:0:37:0:(genops.c:885:class_export_put()) final put ffffa0f2c3480800/839a7a74-1b4a-4cd3-9548-e5ffe194716c 00000020:00000080:2.0:1787430873.835273:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c3480800/839a7a74-1b4a-4cd3-9548-e5ffe194716c for MGC192.168.204.160@tcp 00000020:01000000:2.0:1787430873.835280:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.160@tcp (839a7a74-1b4a-4cd3-9548-e5ffe194716c) 00000020:00000080:2.0:1787430873.835580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fefaf000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787430873.835795:0:13278:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787430873.835801:0:13278:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787430873.835806:0:13278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787430873.835812:0:13278:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787430873.836038:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0f2d0495800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787430873.836839:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787430873.836979:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787430873.839858:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787430873.839978:0:8453:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffffa0f2fe694400:8453] 2 exiting: rc = 0 00000100:00100000:1.0:1787430873.840016:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0f2c5670000:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1787430873.843864:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa0f2c9c84600:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1787430873.843994:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.844400:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa0f2c9c85c00:5822] 0 exiting: rc = 1 00000100:00100000:2.0:1787430873.844454:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa0f2c2e9de00:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1787430873.845512:0:11667:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffffa0f2f7d7a200:11667] 4 exiting: rc = 0 00000100:00100000:1.0:1787430873.847641:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa0f2c2e9d600:5824] 2 exiting: rc = 0 00000100:00100000:1.0:1787430873.850703:0:8455:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0f2c5675c00:8455] 3 exiting: rc = 0 00000100:00100000:2.0:1787430873.850901:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850910:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850916:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850921:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850928:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850934:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850940:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850945:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850950:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850957:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850963:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850969:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850975:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850981:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850987:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850993:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.850999:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851004:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851008:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851014:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851019:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851024:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851028:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851033:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851050:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851055:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851060:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851064:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851069:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851075:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851081:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851086:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851092:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851096:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851101:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851106:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851111:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851116:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851121:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851126:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851131:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851136:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851141:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851146:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851150:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851156:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851161:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851166:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851171:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851176:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851181:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851185:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851190:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851195:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851200:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851204:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851209:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851214:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851219:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851232:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851236:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851241:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851246:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.851252:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787430873.853917:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787430873.853930:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787430873.853935:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2fe93b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787430873.853940:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2fe93b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787430873.853946:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787430873.853996:0:13278:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f1c4de8800 1 00000020:00000080:2.0:1787430873.854002:0:13278:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1fa5b1e070e68c2e 00000020:00000080:2.0:1787430873.854009:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2f73c6800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787430873.854033:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787430873.854038:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787430873.854043:0:13278:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787430873.854047:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa0f2c3eccd28) has no exports 00000020:00000080:1.0:1787430873.854294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2f73c6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787430873.891253:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787430873.891269:0:13278:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787430873.891274:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2d0494000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787430873.891279:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2d0494000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787430873.891291:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787430873.891787:0:13278:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0f2d0491800 00000020:01000000:1.0:1787430873.891822:0:13278:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787430873.891826:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787430873.891831:0:13278:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787430873.891835:0:13278:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffffa0f2fe36b370) has no exports 00000020:00000080:1.0:1787430873.891857:0:13278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787430873.891864:0:13278:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787430873.891866:0:13278:0:(genops.c:885:class_export_put()) final put ffffa0f2c562c800/OSS_uuid 00000020:00000080:1.0:1787430873.891869:0:13278:0:(genops.c:844:class_export_destroy()) destroying export ffffa0f2c562c800/OSS_uuid for OSS 00000020:01000000:1.0:1787430873.891872:0:13278:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787430873.892699:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa0f2d107ea00:6683] 0 exiting: rc = 1 00000100:00080000:1.0:1787430873.892771:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787430873.893661:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa0f2c6236400:6686] 2 exiting: rc = 0 00000100:00100000:0.0:1787430873.893729:0:12537:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffffa0f1c780f600:12537] 4 exiting: rc = 0 00000100:00100000:0.0:1787430873.893813:0:8633:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa0f2feb85c00:8633] 3 exiting: rc = 0 00000100:00100000:2.0:1787430873.896288:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa0f2c6236c00:6685] 1 exiting: rc = 0 00000100:00100000:1.0:1787430873.896932:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.896947:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.896995:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897004:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897009:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897014:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897020:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897025:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897031:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897036:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897042:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897060:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897065:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897069:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897073:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897077:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897082:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897086:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897090:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897094:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897098:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897103:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897107:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897111:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897116:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897121:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897126:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897130:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897135:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897141:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897146:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897151:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897156:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897161:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897167:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897171:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897176:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897181:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897187:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897192:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897196:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897200:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897205:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897211:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897215:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897221:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897233:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897238:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897243:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897248:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897253:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897258:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897262:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897267:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897271:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897275:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897280:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897285:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897290:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897295:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897300:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897681:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897690:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.897695:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787430873.898803:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0f2c6236a00:6687] 0 exiting: rc = 1 00000100:00100000:0.0:1787430873.899443:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa0f2c6237c00:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1787430873.899527:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899533:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899538:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899543:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899548:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899553:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899558:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899564:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899569:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899574:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899579:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899585:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899590:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899595:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899600:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899605:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899611:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899617:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899622:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899626:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899632:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899638:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899643:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899648:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899654:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899660:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899677:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899682:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899688:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899694:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899700:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899708:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899717:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899726:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899736:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899746:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899757:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899769:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899780:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899789:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899797:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899809:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899820:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899829:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899839:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899850:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899861:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899871:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899882:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899893:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899903:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899912:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899923:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899930:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899939:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899948:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899956:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899963:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899970:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899978:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.899989:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.900002:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.900008:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787430873.900015:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.906781:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa0f2ec051c00:6691] 2 exiting: rc = 0 00000100:00100000:0.0:1787430873.906833:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa0f2c7fb1000:6690] 1 exiting: rc = 0 00000100:00100000:0.0:1787430873.907010:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa0f2c7fb0200:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1787430873.907078:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907089:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907098:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907104:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907114:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907121:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907174:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907182:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907187:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907194:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907201:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907209:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907216:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907223:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907229:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907236:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907241:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907265:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907272:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907929:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907952:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907958:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907963:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907968:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907973:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907977:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907983:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907988:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.907994:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908000:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908006:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908011:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908017:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908024:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908029:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908035:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908042:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908048:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908054:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908059:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908065:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908071:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908077:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908083:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908105:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908112:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908119:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908125:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908132:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908137:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908143:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908150:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908164:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908169:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908175:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908182:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908187:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908194:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908200:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908206:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908211:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908216:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908221:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787430873.908226:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.914765:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0f2ec051200:6692] 0 exiting: rc = 1 00000100:00100000:3.0:1787430873.914887:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa0f2ec051400:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1787430873.914993:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915001:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915006:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915012:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915017:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915022:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915027:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915032:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915038:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915043:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915049:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915054:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915058:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915076:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915081:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915086:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915092:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915097:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915102:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915108:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915114:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915118:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915123:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915129:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915134:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915138:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915143:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915149:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915154:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915159:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915163:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915168:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915173:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915179:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915185:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915190:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915196:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915202:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915207:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915212:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915217:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915223:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915228:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915233:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915238:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915244:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915249:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915254:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915268:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915274:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915280:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915287:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915292:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915298:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915622:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915631:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915637:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915641:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915647:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915651:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915656:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915660:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915666:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.915671:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916708:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0f2c5356c00:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1787430873.916825:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa0f2c5356600:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1787430873.916920:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916927:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916939:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916965:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916973:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916978:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916983:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916989:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.916995:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917001:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917007:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917013:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917019:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917026:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917031:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917052:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917060:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917065:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917081:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917086:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917091:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917098:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917104:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917111:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917117:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917124:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917129:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917150:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917157:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917162:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917168:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917175:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917180:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917186:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917193:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917198:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917206:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917211:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917217:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917230:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917237:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917243:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917248:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917254:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917274:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917282:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917288:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917294:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917300:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917676:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917683:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917691:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917696:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917709:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917716:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917722:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917745:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917753:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917759:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917765:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917771:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917776:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917782:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787430873.917788:0:13278:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787430873.927879:0:13278:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787430887.939677:0:13894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787430894.699304:0:14357:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787430894.699309:0:14357:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787430894.699444:0:14357:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0f1c733e800 00000020:01000004:2.0:1787430894.699459:0:14357:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787430894.699467:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787430894.699479:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa0f2c3ecb370) 00000020:00000080:2.0:1787430894.699491:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787430894.712622:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787430894.714535:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787430894.714914:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787430894.715199:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787430894.715270:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787430894.715399:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787430894.715555:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787430894.715649:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787430894.715746:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787430894.716014:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1787430894.717253:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 273: rc = 0 00100000:10000000:3.0:1787430894.717383:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 273: rc = 0 00100000:10000000:3.0:1787430894.717763:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 276: rc = 0 00100000:10000000:3.0:1787430894.718239:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 276: rc = 0 00100000:10000000:3.0:1787430894.718601:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 276: rc = 0 00100000:10000000:3.0:1787430894.718839:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 276: rc = 0 00100000:10000000:3.0:1787430894.719094:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 276: rc = 0 00100000:10000000:3.0:1787430894.719446:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 276: rc = 0 00100000:10000000:3.0:1787430894.719691:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 276: rc = 0 00100000:10000000:3.0:1787430894.719922:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 276: rc = 0 00100000:10000000:3.0:1787430894.720237:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 276: rc = 0 00100000:10000000:3.0:1787430894.720572:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 276: rc = 0 00100000:10000000:3.0:1787430894.720836:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 276: rc = 0 00100000:10000000:3.0:1787430894.721096:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 276: rc = 0 00100000:10000000:3.0:1787430894.721671:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 597: rc = 0 00100000:10000000:3.0:1787430894.721929:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 597: rc = 0 00100000:10000000:3.0:1787430894.722427:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 597: rc = 0 00100000:10000000:3.0:1787430894.722673:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 597: rc = 0 00100000:10000000:3.0:1787430894.722930:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 597: rc = 0 00100000:10000000:3.0:1787430894.723289:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 597: rc = 0 00100000:10000000:3.0:1787430894.723563:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 597: rc = 0 00100000:10000000:3.0:1787430894.723804:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 597: rc = 0 00100000:10000000:3.0:1787430894.724071:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 597: rc = 0 00100000:10000000:3.0:1787430894.724536:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 597: rc = 0 00100000:10000000:3.0:1787430894.724786:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 597: rc = 0 00100000:10000000:3.0:1787430894.725040:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 597: rc = 0 00100000:10000000:3.0:1787430894.725454:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 597: rc = 0 00100000:10000000:3.0:1787430894.725720:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 597: rc = 0 00100000:10000000:3.0:1787430894.725993:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 597: rc = 0 00100000:10000000:3.0:1787430894.726310:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 597: rc = 0 00100000:10000000:3.0:1787430894.726677:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 597: rc = 0 00100000:10000000:3.0:1787430894.726929:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 597: rc = 0 00100000:10000000:3.0:1787430894.727389:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 597: rc = 0 00100000:10000000:3.0:1787430894.727640:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 597: rc = 0 00100000:10000000:3.0:1787430894.727900:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 597: rc = 0 00100000:10000000:3.0:1787430894.728462:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 597: rc = 0 00100000:10000000:3.0:1787430894.728705:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 597: rc = 0 00100000:10000000:3.0:1787430894.728969:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 597: rc = 0 00100000:10000000:3.0:1787430894.729294:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 597: rc = 0 00100000:10000000:3.0:1787430894.729581:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 597: rc = 0 00100000:10000000:3.0:1787430894.729833:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 597: rc = 0 00100000:10000000:3.0:1787430894.730088:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 597: rc = 0 00100000:10000000:3.0:1787430894.730515:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 597: rc = 0 00100000:10000000:3.0:1787430894.730930:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 597: rc = 0 00100000:10000000:3.0:1787430894.731292:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 597: rc = 0 00100000:10000000:3.0:1787430894.731565:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 597: rc = 0 00100000:10000000:3.0:1787430894.731945:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 770: rc = 0 00100000:10000000:3.0:1787430894.732673:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787430894.732851:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 274: rc = 0 00100000:10000000:3.0:1787430894.733053:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787430894.733196:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 274: rc = 0 00100000:10000000:3.0:1787430894.733405:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787430894.733473:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 274: rc = 0 00100000:10000000:3.0:1787430894.733814:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787430894.733885:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:3.0:1787430894.734077:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787430894.734544:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:3.0:1787430894.734746:0:14357:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787430894.734815:0:14357:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00000020:00000080:3.0:1787430894.735080:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787430894.735088:0:14357:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787430894.735097:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69d5a 00000020:01000004:3.0:1787430894.735105:0:14357:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787430894.735110:0:14357:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787430894.735114:0:14357:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0f1c733e800 from MGS 00000020:01000004:3.0:1787430894.735193:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787430894.735205:0:14357:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0f2fe368000) 00000020:00000080:3.0:1787430894.735219:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787430894.735278:0:14357:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f1c733e800 from MGS, refs=2 00080000:01000000:3.0:1787430894.735283:0:14357:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787430894.735288:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69d68 00000100:00100000:3.0:1787430894.735406:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787430894.735534:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787430894.735540:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787430894.736106:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787430894.736113:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787430894.736811:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430894.736968:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787430894.736973:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787430894.737567:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787430894.737574:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787430894.737978:0:14357:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787430894.737985:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787430894.738785:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430894.738789:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430894.738791:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430894.739215:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430894.739218:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430894.739219:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430894.739791:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787430894.743665:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787430894.755685:0:14357:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787430894.755704:0:14357:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787430894.755706:0:14357:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787430894.758976:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787430894.759171:0:14357:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787430894.759288:0:14357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787430894.761027:0:14357:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787430894.761407:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430894.761717:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787430894.761724:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787430894.763773:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787430894.763785:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787430894.764209:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787430894.764217:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787430894.764757:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787430894.764777:0:14357:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.160@tcp' 00000020:01000004:0.0:1787430894.764779:0:14357:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787430894.764808:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.160@tcp (typ=mgc) 00000020:00000080:0.0:1787430894.764821:0:14357:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.160@tcp (ffffa0f2ed3299b8) 00000020:00000080:0.0:1787430894.764841:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787430894.764924:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2c624e000@MGC192.168.204.160@tcp: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787430894.765082:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.160@tcp-0 is initialized 00000040:01000000:0.0:1787430894.765088:0:14357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787430894.765447:0:14371:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787430894.765543:0:14372:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787430894.765614:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.160@tcp (uuid 1ec3bb70-eba8-428d-9804-5196e7d74be3) 00000020:00000080:0.0:1787430894.765630:0:14357:0:(genops.c:1385:class_connect()) connect: client 1ec3bb70-eba8-428d-9804-5196e7d74be3, cookie 0x1fa5b1e070e69d76 00000100:00080000:0.0:1787430894.765640:0:14357:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430894.765645:0:14357:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffffa0f2c624e000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787430894.765680:0:14357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2c35fdf80 x1874256856166272/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787430894.765710:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1ec3bb70-eba8-428d-9804-5196e7d74be3->MGS 00000020:01000004:0.0:1787430894.765733:0:14357:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787430894.765743:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787430894.765753:0:14357:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa0f2ed32b370) 00000020:00000080:0.0:1787430894.765761:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787430894.768526:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1ec3bb70-eba8-428d-9804-5196e7d74be3:3306:1874256856166272:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787430894.768610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430894.772975:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856166272 00000100:00100000:1.0:1787430894.772991:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856166272 00000100:00100000:1.0:1787430894.773043:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430894.773052:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1874256856166272:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787430894.773079:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1ec3bb70-eba8-428d-9804-5196e7d74be3@0@lo t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:1.0:1787430894.773116:0:14368:0:(genops.c:1385:class_connect()) connect: client 1ec3bb70-eba8-428d-9804-5196e7d74be3, cookie 0x1fa5b1e070e69d84 00000100:00080000:1.0:1787430894.773286:0:14368:0:(import.c:65:import_set_state_nolock()) ffffa0f2c9284000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430894.773406:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+5:3306:x1874256856166272:12345-0@lo:250:mount.lustre.0 Request processed in 353us (4795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430894.773415:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430894.773464:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787430894.773474:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:1.0:1787430894.773482:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787430894.773486:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787430894.773489:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c624e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787430894.773492:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787430894.773502:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787430894.773508:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1ec3bb70-eba8-428d-9804-5196e7d74be3:3306:1874256856166272:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787430894.780282:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787430894.780574:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787430894.780797:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787430894.782054:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787430894.782069:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787430894.783159:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787430894.783168:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787430894.784061:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430894.784234:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787430894.784239:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787430894.785576:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787430894.785587:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787430894.819134:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430894.819428:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787430894.819435:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787430894.820588:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787430894.820597:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787430894.821205:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430894.821390:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787430894.821400:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787430894.821882:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787430894.821888:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787430894.822440:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430894.822699:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787430894.822705:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787430894.823169:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787430894.823176:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787430894.823868:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430894.824077:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787430894.824082:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787430894.824653:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787430894.824660:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787430894.842703:0:14357:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430894.843020:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787430894.843028:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787430894.844297:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787430894.844309:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787430894.845244:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787430894.845253:0:14357:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787430894.846151:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787430894.846174:0:14357:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787430894.846181:0:14357:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787430894.846614:0:14357:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787430894.848006:0:14357:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787430894.848014:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787430894.848016:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787430894.848017:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430894.848018:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430894.848019:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430894.848020:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430894.848022:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430894.848023:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787430894.848024:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430894.848025:0:14357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787430894.848029:0:14357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787430894.848031:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430894.848032:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787430894.848033:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430894.848209:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430894.848210:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430894.848211:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430894.848212:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787430894.848213:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787430894.848214:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430894.848215:0:14357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787430894.848269:0:14357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787430894.848294:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166400:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787430894.852210:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430894.853143:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c785ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430894.853597:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856166400 00000100:00100000:0.0:1787430894.853609:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856166400 00000100:00100000:0.0:1787430894.854200:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430894.854212:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+5:14357:x1874256856166400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430894.854255:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430894.854258:0:14370:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787430894.854261:0:14370:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787430894.854629:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787430894.855122:0:14370:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787430894.856459:0:14392:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787430894.856465:0:14392:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787430894.856468:0:14392:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787430894.856504:0:14392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787430894.856786:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787430894.856796:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787430894.872015:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+5:14357:x1874256856166400:12345-0@lo:253:mount.lustre.0 Request processed in 17797us (19803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430894.872031:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430894.872148:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787430894.872166:0:14357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787430894.872169:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787430894.872171:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787430894.872173:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787430894.872174:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787430894.872175:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787430894.872176:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787430894.872177:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787430894.872179:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787430894.872181:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787430894.872182:0:14357:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787430894.872203:0:14357:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0f1c733e800 from lustre-MDT0000 10000000:01000000:0.0:1787430894.872234:0:14357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787430894.872237:0:14357:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787430894.872241:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0f2ed3299b8 10000000:01000000:0.0:1787430894.872258:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430894.872267:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0f2ed3299b8 from 1 10000000:01000000:0.0:1787430894.872269:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787430894.872308:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.872319:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.872436:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.872459:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430894.872502:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.872574:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430894.872831:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856166528 00000100:00100000:3.0:1787430894.872844:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856166528 00000100:00100000:3.0:1787430894.872924:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787430894.872944:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+5:14357:x1874256856166528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430894.872957:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430894.872971:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e69d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69d8b expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430894.872993:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e69d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69d8b expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430894.873002:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147be00/0x1fa5b1e070e69d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69d8b expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430894.873012:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147be00, rc 0) 00000100:00100000:3.0:1787430894.873056:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+6:14357:x1874256856166528:12345-0@lo:101:mount.lustre.0 Request processed in 124us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430894.873063:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430894.873140:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430894.873153:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.873162:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.873213:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430894.873238:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.873564:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430894.873689:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856166656 00000100:00100000:1.0:1787430894.873695:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856166656 00000100:00100000:1.0:1787430894.873722:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430894.873730:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+6:14357:x1874256856166656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430894.873984:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+6:14357:x1874256856166656:12345-0@lo:501:mount.lustre.0 Request processed in 254us (744us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430894.873992:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430894.874066:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166656:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787430894.874095:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787430894.874239:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874257:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430894.874265:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0f1c733e800 10000000:01000000:0.0:1787430894.874269:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787430894.874274:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0f1c733e800 10000000:01000000:0.0:1787430894.874276:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787430894.874280:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0f1c733e800 from 1 10000000:01000000:0.0:1787430894.874282:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787430894.874307:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874314:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874322:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.874362:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430894.874391:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.874405:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430894.874472:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856166784 00000100:00100000:1.0:1787430894.874477:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856166784 00000100:00100000:1.0:1787430894.874496:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430894.874567:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+6:14357:x1874256856166784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430894.874577:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430894.874592:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a5600/0x1fa5b1e070e69da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69d99 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.874608:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a5600/0x1fa5b1e070e69da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69d99 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.874618:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a5600/0x1fa5b1e070e69da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69d99 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.874625:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5600, rc 0) 00000100:00100000:1.0:1787430894.874660:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+7:14357:x1874256856166784:12345-0@lo:101:mount.lustre.0 Request processed in 158us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430894.874676:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787430894.874748:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430894.874760:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69da0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874768:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69da0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430894.874788:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787430894.874802:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69da0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874809:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263400/0x1fa5b1e070e69d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69da0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430894.874815:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787430894.874819:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430894.874823:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0f1c733e800 10000000:01000000:0.0:1787430894.874825:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787430894.874828:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787430894.874830:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430894.874844:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874850:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.874858:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.874870:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430894.874893:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.874911:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430894.874970:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856166912 00000100:00100000:1.0:1787430894.874974:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856166912 00000100:00100000:1.0:1787430894.874992:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430894.874997:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+7:14357:x1874256856166912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430894.875004:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430894.875012:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4200/0x1fa5b1e070e69dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69da7 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.875024:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4200/0x1fa5b1e070e69dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69da7 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.875031:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a4200/0x1fa5b1e070e69dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69da7 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.875038:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4200, rc 0) 00000100:00100000:1.0:1787430894.875108:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+8:14357:x1874256856166912:12345-0@lo:101:mount.lustre.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430894.875240:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430894.875587:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856166912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430894.875601:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69dae expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.875617:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69dae expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.875672:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430894.875700:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.875760:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430894.875799:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856167040 00000100:00100000:1.0:1787430894.875804:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856167040 00000100:00100000:1.0:1787430894.875865:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430894.875872:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+8:14357:x1874256856167040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430894.876792:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14357:x1874256856167040:12345-0@lo:501:mount.lustre.0 Request processed in 918us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.876802:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787430894.876870:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430894.876906:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430894.876959:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.877026:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.877067:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856167168 00000100:00100000:2.0:1787430894.877072:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856167168 00000100:00100000:2.0:1787430894.877254:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787430894.877263:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14357:x1874256856167168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430894.877719:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14357:x1874256856167168:12345-0@lo:503:mount.lustre.0 Request processed in 456us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.877727:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787430894.877811:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430894.878554:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14393:1874256856167296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430894.878608:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430894.878658:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856167296 00000100:00100000:2.0:1787430894.878664:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856167296 00000100:00100000:0.0:1787430894.878670:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c4948240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.878700:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787430894.878708:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14393:x1874256856167296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430894.878997:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14393:x1874256856167296:12345-0@lo:502:llog_process_th.0 Request processed in 289us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.879006:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787430894.879272:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14393:1874256856167296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430894.879297:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430894.879308:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430894.879310:0:14393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787430894.879317:0:14393:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787430894.879320:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430894.879516:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0f2ed328000) 00000020:00000080:0.0:1787430894.879534:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787430894.879541:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787430894.879609:0:14393:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787430894.879616:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69dbc 00000020:00000080:0.0:1787430894.879825:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787430894.879830:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430894.879834:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430894.879835:0:14393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787430894.879838:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787430894.879842:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430894.879843:0:14393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787430894.879847:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430894.879854:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0f2ed32cd28) 00000020:00000080:0.0:1787430894.879864:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787430894.879868:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787430894.879870:0:14393:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787430894.879873:0:14393:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787430894.879878:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787430894.879918:0:14393:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f1c733e800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787430894.879943:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0f2ec253370) 00000020:00000080:0.0:1787430894.879953:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787430894.880005:0:14393:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787430894.880011:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e69dd1 00000020:00000080:0.0:1787430894.880096:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787430894.880102:0:14393:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787430894.880106:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1fa5b1e070e69dd8 00080000:01000000:0.0:1787430894.880245:0:14393:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787430894.880250:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69ddf 00010000:00010000:3.0:1787430894.937302:0:14393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787430894.937818:0:14393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787430894.938026:0:14393:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787430894.938883:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0f2fe36b370) 00000020:00000080:3.0:1787430894.938901:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787430894.938998:0:14393:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787430894.939007:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69ded 00000020:00000080:0.0:1787430894.939722:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787430894.945810:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1fa5b1e070e69df4 00000020:00000080:2.0:1787430894.946429:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787430894.946441:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430894.946449:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.946451:0:14393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787430894.946456:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430894.946461:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.946463:0:14393:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787430894.946467:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787430894.946503:0:14393:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787430894.946516:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430894.946519:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.946521:0:14393:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787430894.946524:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787430894.946526:0:14393:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787430894.946528:0:14393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787430894.946529:0:14393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787430894.946532:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787430894.946534:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.946535:0:14393:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787430894.946538:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787430894.946541:0:14393:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787430894.946544:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.946546:0:14393:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787430894.946549:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430894.946554:0:14393:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:2.0:1787430894.946579:0:14393:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787430894.946582:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430894.946595:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0f2c3ec8000) 00000020:00000080:2.0:1787430894.946609:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787430894.946613:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430894.946681:0:14393:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787430894.946686:0:14393:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787430894.946692:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69e02 00010000:00080000:2.0:1787430894.946729:0:14393:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2fe8d8000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787430894.946958:0:14393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787430894.947486:0:14393:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787430894.947528:0:14393:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787430894.948505:0:14393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430894.948570:0:14393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787430894.948640:0:14393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787430894.949047:0:14397:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787430894.949052:0:14397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787430894.954545:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787430894.954562:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787430894.954600:0:14393:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787430894.954619:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e69e09 00000100:00080000:2.0:1787430894.954630:0:14393:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787430894.954636:0:14393:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0f2fe8d8000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787430894.954673:0:14393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c10bbb80 x1874256856167424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430894.954748:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856167424:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787430894.954806:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256856167424 offset 0 length 520: 4 00000100:00080000:2.0:1787430894.954871:0:14393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787430894.954944:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430894.954949:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.954951:0:14393:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787430894.954955:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787430894.954958:0:14393:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787430894.954959:0:14393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787430894.954961:0:14393:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787430894.954963:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787430894.954965:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.954967:0:14393:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787430894.954970:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787430894.954974:0:14393:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787430894.954978:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.954987:0:14393:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787430894.954993:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787430894.954996:0:14393:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:2.0:1787430894.955018:0:14393:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787430894.955021:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787430894.955045:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0f2c3eccd28) 00000020:00000080:2.0:1787430894.955059:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787430894.955064:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787430894.955209:0:14393:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787430894.955215:0:14393:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787430894.955223:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1fa5b1e070e69e17 00010000:00080000:2.0:1787430894.955258:0:14393:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2c562c000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787430894.955475:0:14393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787430894.955684:0:14393:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787430894.955708:0:14393:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787430894.957912:0:14393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430894.958027:0:14393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787430894.958122:0:14393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787430894.959299:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787430894.959305:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787430894.960260:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787430894.960274:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787430894.960306:0:14393:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787430894.960503:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e69e1e 00000100:00080000:3.0:1787430894.960517:0:14393:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430894.960524:0:14393:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0f2c562c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430894.960584:0:14393:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c4c9a300 x1874256856167552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787430894.960911:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856167552:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787430894.960992:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256856167552 offset 0 length 520: 4 00000100:00080000:3.0:1787430894.961122:0:14393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787430894.961195:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430894.961200:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.961202:0:14393:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787430894.961205:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430894.961210:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.961211:0:14393:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787430894.961214:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787430894.961216:0:14393:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787430894.961218:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430894.961220:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.961222:0:14393:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787430894.961224:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430894.961227:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.961228:0:14393:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787430894.961232:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787430894.961266:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14393:1874256856167680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430894.961349:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430894.961370:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.961561:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856167680 00000100:00100000:2.0:1787430894.961568:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856167680 00000100:00100000:2.0:1787430894.961619:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430894.961630:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14393:x1874256856167680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430894.961903:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14393:x1874256856167680:12345-0@lo:502:llog_process_th.0 Request processed in 274us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.961911:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787430894.962029:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14393:1874256856167680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787430894.962068:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787430894.962074:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430894.962076:0:14393:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787430894.962080:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787430894.962381:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787430894.962400:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787430894.962418:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69dae expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.962438:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263000/0x1fa5b1e070e69da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69dae expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430894.962446:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f1c733e800 from 1 10000000:01000000:2.0:1787430894.962449:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430894.962482:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.962490:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.962499:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430894.962516:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430894.962551:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430894.962578:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c62323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430894.962740:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856167808 00000100:00100000:3.0:1787430894.962746:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856167808 00000100:00100000:3.0:1787430894.962820:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430894.962828:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+9:14357:x1874256856167808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430894.962839:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430894.962852:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69e25 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430894.962872:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430894.962889:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430894.962898:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a600, rc 0) 00000100:00100000:3.0:1787430894.962953:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+10:14357:x1874256856167808:12345-0@lo:101:mount.lustre.0 Request processed in 126us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430894.962960:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430894.963148:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430894.963170:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.963180:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.963756:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167936:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787430894.963801:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.964220:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.964257:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856167936 00000100:00100000:2.0:1787430894.964264:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856167936 00000100:00100000:2.0:1787430894.964299:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787430894.964307:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+10:14357:x1874256856167936:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787430894.964445:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787430894.964453:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787430894.964640:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+10:14357:x1874256856167936:12345-0@lo:256:mount.lustre.0 Request processed in 333us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.964649:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430894.964800:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856167936:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787430894.965627:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787430894.965692:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.965705:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430894.965713:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c733e800 from 1 10000000:01000000:0.0:1787430894.965715:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430894.965750:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.965757:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.965767:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.965785:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430894.965839:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.965875:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.965946:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168064 00000100:00100000:2.0:1787430894.965958:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168064 00000100:00100000:2.0:1787430894.966000:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787430894.966008:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+10:14357:x1874256856168064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430894.966018:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430894.966031:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69e33 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.966198:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.966210:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.966219:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74a00, rc 0) 00000100:00100000:2.0:1787430894.966264:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14357:x1874256856168064:12345-0@lo:101:mount.lustre.0 Request processed in 257us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.966271:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787430894.966386:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430894.966400:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430894.966409:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430894.966469:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430894.966496:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.966516:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.966565:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168192 00000100:00100000:2.0:1787430894.966570:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168192 00000100:00100000:2.0:1787430894.966600:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787430894.966608:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14357:x1874256856168192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430894.967003:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14357:x1874256856168192:12345-0@lo:501:mount.lustre.0 Request processed in 395us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.967010:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787430894.967281:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430894.967311:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430894.967388:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430894.967408:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6441c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.967481:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168320 00000100:00100000:2.0:1787430894.967486:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168320 00000100:00100000:2.0:1787430894.967515:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787430894.967522:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14357:x1874256856168320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430894.967675:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14357:x1874256856168320:12345-0@lo:503:mount.lustre.0 Request processed in 154us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.967682:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787430894.967781:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430894.969021:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14401:1874256856168448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430894.969248:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430894.969342:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430894.969407:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168448 00000100:00100000:0.0:1787430894.969414:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168448 00000100:00100000:0.0:1787430894.969503:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787430894.969513:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14401:x1874256856168448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787430894.969771:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14401:x1874256856168448:12345-0@lo:502:llog_process_th.0 Request processed in 259us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430894.969779:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787430894.969862:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14401:1874256856168448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787430894.969890:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430894.969899:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.969901:0:14401:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787430894.969909:0:14401:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f1c733e800 00000020:00000080:3.0:1787430894.969911:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430894.969920:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430894.969923:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.969924:0:14401:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787430894.969927:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430894.969940:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.969942:0:14401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787430894.969946:0:14401:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f1c733e800 00000020:00000080:3.0:1787430894.969948:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430894.970017:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430894.970020:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.970021:0:14401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787430894.970024:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430894.970026:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430894.970027:0:14401:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430894.970030:0:14401:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0f1c733e800 00000020:00000080:3.0:1787430894.970041:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787430894.970089:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14401:1874256856168576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430894.973350:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430894.974368:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168576 00000100:00100000:2.0:1787430894.974380:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168576 00000100:00100000:2.0:1787430894.974425:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430894.974434:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14401:x1874256856168576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430894.974665:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14401:x1874256856168576:12345-0@lo:502:llog_process_th.0 Request processed in 231us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.974673:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787430894.977738:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c34c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.977779:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14401:1874256856168576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787430894.977817:0:14401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430894.977825:0:14401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430894.977828:0:14401:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787430894.977832:0:14401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787430894.977995:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787430894.978015:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787430894.978046:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.978058:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430894.978106:0:14357:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787430894.978110:0:14357:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0f1c733e800 10000000:01000000:1.0:1787430894.978113:0:14357:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0f1c733e800 10000000:01000000:1.0:1787430894.978232:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787430894.978239:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f1c733e800 from 1 10000000:01000000:1.0:1787430894.978242:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787430894.978277:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.978286:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.978296:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430894.978316:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787430894.978410:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430894.978434:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.978507:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168704 00000100:00100000:2.0:1787430894.978514:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168704 00000100:00100000:2.0:1787430894.978562:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787430894.978572:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14357:x1874256856168704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430894.978584:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430894.978597:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e69e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69e41 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.978636:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e69e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e41 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.978646:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74400/0x1fa5b1e070e69e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e41 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430894.978655:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74400, rc 0) 00000100:00100000:2.0:1787430894.978695:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856168704:12345-0@lo:101:mount.lustre.0 Request processed in 124us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.978702:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787430894.978783:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430894.978797:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e48 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430894.978813:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69e48 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430894.978860:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430894.978885:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430894.978907:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.978955:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168832 00000100:00100000:2.0:1787430894.978960:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168832 00000100:00100000:2.0:1787430894.978990:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787430894.978997:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856168832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430894.979410:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856168832:12345-0@lo:501:mount.lustre.0 Request processed in 412us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.979418:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787430894.980446:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430894.980493:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430894.980542:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430894.980566:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.980627:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856168960 00000100:00100000:2.0:1787430894.980634:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856168960 00000100:00100000:2.0:1787430894.980676:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787430894.980684:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856168960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430894.980864:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856168960:12345-0@lo:503:mount.lustre.0 Request processed in 180us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.980872:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787430894.980960:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856168960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430894.981559:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14404:1874256856169088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430894.981602:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430894.981667:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430894.987178:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169088 00000100:00100000:2.0:1787430894.987194:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169088 00000100:00100000:2.0:1787430894.987258:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787430894.987270:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14404:x1874256856169088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787430894.987578:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14404:x1874256856169088:12345-0@lo:502:llog_process_th.0 Request processed in 309us (5974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430894.987587:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787430894.988403:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14404:1874256856169088:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787430894.988477:0:14404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787430894.988493:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0f2fe36cd28) 00000020:00000080:3.0:1787430894.988511:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787430894.988599:0:14404:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f1c733e800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787430894.988604:0:14404:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f1c733e800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787430894.988606:0:14404:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f1c733e800 4 00010000:00080000:3.0:1787430894.991252:0:14404:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2c622a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787430895.002264:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787430895.002488:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787430895.002525:0:14404:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787430895.002539:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1fa5b1e070e69e56 00000100:00080000:3.0:1787430895.002551:0:14404:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430895.002558:0:14404:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0f2c622a000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430895.002593:0:14404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c4c99500 x1874256856169216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430895.002615:0:14404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787430895.007486:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856169216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430895.007647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430895.007835:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14404:1874256856169344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787430895.007880:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430895.007906:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169344 00000100:00100000:1.0:1787430895.007913:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169344 00000100:00100000:1.0:1787430895.007967:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430895.007977:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14404:x1874256856169344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787430895.008245:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169216 00000100:00100000:3.0:1787430895.008251:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169216 00000100:00100000:3.0:1787430895.008275:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430895.008280:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1874256856169216:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787430895.008356:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1874256856169216:12345-0@lo:38:llog_process_th.0 Request processed in 74us (708us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787430895.008362:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430895.008404:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787430895.008419:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787430895.008423:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787430895.008427:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856169216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430895.008857:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14404:x1874256856169344:12345-0@lo:502:llog_process_th.0 Request processed in 881us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430895.008870:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787430895.008913:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430895.009183:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec3bb70-eba8-428d-9804-5196e7d74be3:14404:1874256856169344:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787430895.009320:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787430895.009443:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787430895.009462:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787430895.009478:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e48 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.009489:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c59a4000/0x1fa5b1e070e69e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e48 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787430895.009537:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787430895.009540:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787430895.009541:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430895.009543:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430895.009544:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430895.009546:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430895.009548:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430895.009550:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787430895.009551:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430895.009553:0:14357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787430895.009557:0:14357:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787430895.009559:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430895.009560:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787430895.009561:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430895.009562:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430895.009563:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430895.009565:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430895.009566:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430895.009567:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787430895.009568:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430895.009569:0:14357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787430895.009595:0:14357:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787430895.009610:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856169472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787430895.009651:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430895.009677:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c6232d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430895.009702:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169472 00000100:00100000:2.0:1787430895.009707:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169472 00000100:00100000:2.0:1787430895.009742:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787430895.009749:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856169472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787430895.009782:0:14369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787430895.009796:0:14369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787430895.052903:0:14369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787430895.052974:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787430895.054107:0:14391:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787430895.054122:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787430895.054145:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430895.054163:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430895.054170:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430895.054211:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430895.054225:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 12 pid: 14368 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430895.054239:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14391:1874256856169600:0@lo:104: 00000100:00100000:1.0:1787430895.054321:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430895.054389:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787430895.054566:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169600 00000100:00100000:3.0:1787430895.054573:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169600 00000100:00100000:3.0:1787430895.054632:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430895.054641:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14391:x1874256856169600:12345-0@lo:104: 00010000:00010000:3.0:1787430895.054655:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430895.054709:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430895.054715:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14391:x1874256856169600:12345-0@lo:104: Request processed in 76us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430895.054722:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430895.054859:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14391:1874256856169600:0@lo:104: 00010000:00010000:1.0:1787430895.054882:0:14391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.056529:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430895.056541:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.056552:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74800 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430895.056556:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.056566:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430895.056574:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430895.056643:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787430895.056697:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.056704:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787430895.056781:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856169728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430895.056858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787430895.056939:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.056953:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74800/0x1fa5b1e070e69e25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e2c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430895.056971:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430895.056973:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430895.056975:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430895.061273:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169728 00000100:00100000:0.0:1787430895.061289:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169728 00010000:00010000:0.0:1787430895.061362:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 13 pid: 14368 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430895.061397:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430895.061407:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+13:3309:x1874256856169728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430895.061420:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430895.061426:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 13 pid: 14368 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061440:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 13 pid: 14368 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061457:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a600/0x1fa5b1e070e69e2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69e25 expref: 13 pid: 14368 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061474:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061483:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430895.061500:0:14360:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007378538s 00010000:00010000:0.0:1787430895.061504:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061511:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061518:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061538:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061544:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430895.061549:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061557:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061575:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430895.061717:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430895.061938:0:14391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430895.061948:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430895.061954:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a5e00/0x1fa5b1e070e69e5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430895.062602:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14357:x1874256856169472:12345-0@lo:253:mount.lustre.0 Request processed in 52850us (52947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430895.062613:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787430895.062761:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:14357:1874256856169472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787430895.062773:0:14357:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787430895.062776:0:14357:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430895.062778:0:14357:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787430895.062779:0:14357:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430895.062780:0:14357:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430895.062782:0:14357:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430895.062783:0:14357:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430895.062784:0:14357:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787430895.062785:0:14357:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787430895.062787:0:14357:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430895.062788:0:14357:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787430895.062803:0:14357:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787430895.063064:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:3309:x1874256856169728:12345-0@lo:103:ldlm_bl.0 Request processed in 1647us (6194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430895.063073:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430895.063139:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856169728:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1787430895.069433:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430895.069696:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430895.070013:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430895.070207:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430895.070530:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430895.071032:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430895.072258:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430895.072517:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430895.072865:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430895.073290:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430895.073690:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430895.073876:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787430895.098915:0:14357:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787430895.099170:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787430895.099397:0:14412:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787430895.099401:0:14412:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787430895.099575:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787430895.099641:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430895.101661:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787430895.101748:0:14413:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787430895.101753:0:14413:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787430895.103982:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787430895.104110:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787430895.104550:0:14357:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787430895.104559:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787430895.105194:0:14357:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430895.106282:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787430895.107001:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787430895.107038:0:14357:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787430895.108690:0:14357:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787430895.113197:0:14357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787430895.137092:0:14357:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787430895.137144:0:14357:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc04f01dd3988 00100000:10000000:1.0:1787430895.137153:0:14357:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787430895.137938:0:14357:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787430895.137954:0:14357:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787430895.137970:0:14357:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787430895.137995:0:14357:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787430895.776410:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430896.031652:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787430896.669392:0:14372:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430896.669401:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f1c733e800 from 6 10000000:01000000:3.0:1787430896.669406:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430896.669462:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430896.669475:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430896.669488:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430896.669512:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856169856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430896.669586:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430896.669639:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7847d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430896.669840:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169856 00000100:00100000:2.0:1787430896.669848:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169856 00000100:00100000:2.0:1787430896.669911:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787430896.669921:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14372:x1874256856169856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430896.669935:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430896.669951:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69e64 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430896.669977:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430896.669987:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430896.669996:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430896.670127:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856169856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430896.670135:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787430896.670543:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856169856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430896.670563:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430896.670575:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430896.670650:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856169984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787430896.670691:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430896.670729:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430896.672166:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856169984 00000100:00100000:3.0:1787430896.672181:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856169984 00000100:00100000:3.0:1787430896.672265:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430896.672275:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856169984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787430896.672297:0:14369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787430896.672342:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787430896.672346:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787430896.672479:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856169984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 205us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430896.672487:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787430896.672539:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856169984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787430896.672607:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430896.672617:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430896.672628:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430896.796512:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787430897.054520:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787430897.823645:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787430898.301680:0:14655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787430898.844553:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430899.868549:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787430900.446456:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430900.446463:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430900.446466:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430900.446469:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430900.446473:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787430900.446477:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787430900.446480:0:471:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787430900.446492:0:471:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0f2c622a000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787430900.446514:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2c35fca80 x1874256856170240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430900.446639:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856170240:0@lo:38:kworker.0 00000100:00100000:0.0:1787430900.446689:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec3bb70-eba8-428d-9804-5196e7d74be3:3310:1874256856170112:0@lo:400:kworker.0 00000100:00100000:2.0:1787430900.446710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430900.446720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430900.446816:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170112 00000100:00100000:2.0:1787430900.446817:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170240 00000100:00100000:2.0:1787430900.446834:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170240 00000100:00100000:3.0:1787430900.446835:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170112 00000100:00100000:2.0:1787430900.446873:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430900.446877:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787430900.446883:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874256856170240:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787430900.446889:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:3310:x1874256856170112:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787430900.446911:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:2.0:1787430900.446954:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1fa5b1e070e69e72 00000100:00100000:3.0:1787430900.446960:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:3310:x1874256856170112:12345-0@lo:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430900.446969:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00100000:2.0:1787430900.446972:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787430900.447261:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec3bb70-eba8-428d-9804-5196e7d74be3:3310:1874256856170112:0@lo:400:kworker.0 00000100:00080000:2.0:1787430900.448899:0:14377:0:(import.c:65:import_set_state_nolock()) ffffa0f2d05a5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430900.448985:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874256856170240:12345-0@lo:38:kworker.0 Request processed in 2101us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430900.449008:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787430900.449019:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0f2c35fca80 x1874256856170240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787430900.449037:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787430900.449046:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787430900.449050:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787430900.449053:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c622a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787430900.449059:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874256856170240:0@lo:38:kworker.0 00000020:00000080:0.0:1787430900.743920:0:14807:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc18a92250 20000000:00000080:0.0:1787430900.743935:0:14807:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f2fd08c400 uarg=0000000000000000 20000000:01000000:0.0:1787430900.743964:0:14807:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787430900.743972:0:14807:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787430900.743981:0:14807:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787430900.745269:0:14808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787430900.745864:0:14807:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787430900.757051:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787430900.758722:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.758745:0:14807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.758753:0:14807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.758872:0:14807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.758890:0:14807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 11 pid: 14370 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430900.758906:0:14807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14807:1874256856170368:0@lo:104: 00000100:00100000:0.0:1787430900.758973:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430900.759193:0:14807:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430900.759516:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170368 00000100:00100000:2.0:1787430900.759524:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170368 00000100:00100000:3.0:1787430900.759708:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787430900.759720:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14807:x1874256856170368:12345-0@lo:104: 00010000:00010000:3.0:1787430900.759733:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430900.759794:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430900.759800:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14807:x1874256856170368:12345-0@lo:104: Request processed in 83us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430900.759807:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430900.759916:0:14807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14807:1874256856170368:0@lo:104: 00010000:00010000:0.0:1787430900.759936:0:14807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430900.759996:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430900.760448:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430900.760457:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430900.760462:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430900.760470:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430900.760477:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430900.760482:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787430900.760525:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430900.760532:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430900.760556:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430900.760575:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263c00/0x1fa5b1e070e69e33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e3a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430900.760603:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430900.760605:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430900.760607:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430900.760636:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856170496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430900.760679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430900.761216:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170496 00000100:00100000:0.0:1787430900.761224:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170496 00010000:00010000:0.0:1787430900.761253:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 12 pid: 14370 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430900.761279:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430900.761287:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:3307:x1874256856170496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430900.761308:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430900.761315:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 12 pid: 14370 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761348:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 12 pid: 14370 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761366:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e69e3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69e33 expref: 12 pid: 14370 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761380:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761388:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761401:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761409:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761416:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761422:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761428:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430900.761433:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761451:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761473:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430900.761490:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430900.761519:0:14807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430900.761529:0:14807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430900.761537:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:3307:x1874256856170496:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (855us total) trans 0 rc 0/0 00010000:00010000:1.0:1787430900.761539:0:14807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c5263a00/0x1fa5b1e070e69e79 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430900.761551:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430900.770611:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856170496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430900.892892:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430901.917038:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787430902.300429:0:14372:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430902.300438:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c733e800 from 10 10000000:01000000:0.0:1787430902.300443:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430902.300485:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430902.300497:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430902.300508:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430902.300534:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856170624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430902.300598:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430902.300653:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787430902.300993:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170624 00000100:00100000:2.0:1787430902.301001:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170624 00000100:00100000:2.0:1787430902.301064:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787430902.301074:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+11:14372:x1874256856170624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430902.301087:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430902.301102:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69e80 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430902.301125:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430902.301134:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430902.301143:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75000, rc 0) 00000100:00100000:2.0:1787430902.301197:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856170624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430902.301217:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787430902.301303:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856170624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430902.301317:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430902.301352:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430902.301408:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856170752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430902.301443:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430902.301462:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430902.301519:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170752 00000100:00100000:0.0:1787430902.301523:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170752 00000100:00100000:0.0:1787430902.301555:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787430902.301569:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856170752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430902.301803:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856170752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430902.301810:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787430902.301902:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856170752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787430902.301929:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856170880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430902.301965:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430902.301991:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430902.302049:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856170880 00000100:00100000:2.0:1787430902.302054:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856170880 00000100:00100000:2.0:1787430902.302083:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787430902.302090:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856170880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430902.302223:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:14372:x1874256856170880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430902.302230:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787430902.302302:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856170880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787430902.304194:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787430902.304373:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787430902.304391:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430902.304401:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430902.304411:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430902.942362:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430903.967410:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787430904.540664:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430894/real 1787430894] req@ffffa0f1c4c9a300 x1874256856167552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430904.540698:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c4c9a300 x1874256856167552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430904.540709:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430894/real 1787430894] req@ffffa0f1c10bbb80 x1874256856167424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430904.540721:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c10bbb80 x1874256856167424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787430904.540774:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430904.540804:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430904.540809:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856167552:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787430904.540815:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe8d8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787430904.540821:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787430904.540824:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856167424:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787430904.541290:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430904.541295:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787430904.541297:0:471:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe8d8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430904.541302:0:471:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 358 00000100:00080000:3.0:1787430904.541307:0:471:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787430904.541314:0:471:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0f2fe8d8000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430904.541380:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c4c99500 x1874256856171136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430904.541395:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787430904.541398:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787430904.541399:0:471:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787430904.541402:0:471:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 358 00000100:00080000:3.0:1787430904.541405:0:471:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787430904.541409:0:471:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0f2c562c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430904.541419:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c4c98000 x1874256856171264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787430904.541429:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856171008:0@lo:400:kworker.0 00000100:00100000:2.0:1787430904.541498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430904.541531:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856171008 00000100:00100000:3.0:1787430904.541538:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856171008 00000100:00100000:3.0:1787430904.541588:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787430904.541597:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:3308:x1874256856171008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430904.541657:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:3308:x1874256856171008:12345-0@lo:400:kworker.0 Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.541665:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787430904.541874:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856171392:0@lo:400:kworker.0 00000100:00100000:1.0:1787430904.541953:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430904.541998:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856171136:0@lo:8:kworker.0 00000400:00000100:1.0:1787430904.542018:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256856171136 offset 0 length 520: 4 00000100:00100000:1.0:1787430904.542031:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856171264:0@lo:8:kworker.0 00000400:00000100:1.0:1787430904.542042:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874256856171264 offset 0 length 520: 4 00000100:00100000:3.0:1787430904.542563:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856171392 00000100:00100000:3.0:1787430904.542571:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856171392 00000100:00100000:3.0:1787430904.542609:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430904.542617:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856171392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430904.542673:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856171392:12345-0@lo:400:kworker.0 Request processed in 56us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.542679:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430904.542815:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856171008:0@lo:400:kworker.0 00010000:00080000:1.0:1787430904.542821:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0f1c4c9b800 x1874256856171392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430904.542838:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856171392:0@lo:400:kworker.0 00000020:01000004:3.0:1787430904.688109:0:15055:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787430904.688113:0:15055:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787430904.688248:0:15055:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0f2fe8a8000 00000020:01000004:3.0:1787430904.688571:0:15055:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787430904.688584:0:15055:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787430904.688598:0:15055:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0f2fe3699b8) 00000020:00000080:3.0:1787430904.688613:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787430904.710958:0:15055:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787430904.711232:0:15055:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787430904.711916:0:15055:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787430904.712113:0:15055:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787430904.712309:0:15055:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787430904.712692:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787430904.712796:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787430904.712911:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787430904.713465:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 453: rc = 0 00100000:10000000:3.0:1787430904.713693:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 453: rc = 0 00100000:10000000:3.0:1787430904.713924:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 453: rc = 0 00100000:10000000:3.0:1787430904.714157:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 453: rc = 0 00100000:10000000:3.0:1787430904.714458:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 453: rc = 0 00100000:10000000:3.0:1787430904.714689:0:15055:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 453: rc = 0 00000020:00000080:3.0:1787430904.715223:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787430904.715233:0:15055:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787430904.715243:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1fa5b1e070e69e95 00000020:01000004:3.0:1787430904.715251:0:15055:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787430904.715271:0:15055:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787430904.715274:0:15055:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787430904.715279:0:15055:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787430904.715284:0:15055:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787430904.715302:0:15055:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0f2c8f33370) 00000020:00000080:3.0:1787430904.715313:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787430904.716704:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430904.716879:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787430904.716885:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787430904.717805:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787430904.717813:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787430904.718126:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787430904.718133:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787430904.726638:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787430904.726826:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787430904.726833:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787430904.728211:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787430904.728220:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787430904.747259:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430904.747620:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787430904.747628:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787430904.750092:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787430904.750107:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787430904.751093:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787430904.751103:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787430904.753243:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787430904.753791:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787430904.753797:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787430904.754540:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787430904.754548:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787430904.782266:0:15055:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787430904.782551:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787430904.782557:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787430904.784008:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787430904.784019:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787430904.784435:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787430904.784462:0:15055:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787430904.784469:0:15055:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787430904.793244:0:15055:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787430904.793281:0:15055:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787430904.793286:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787430904.793287:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430904.793289:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430904.793290:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430904.793291:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430904.793292:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430904.793294:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430904.793296:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430904.793297:0:15055:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430904.793301:0:15055:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787430904.793303:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430904.793304:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430904.793305:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430904.793306:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430904.793307:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430904.793308:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430904.793309:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430904.793311:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430904.793312:0:15055:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787430904.793466:0:15055:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787430904.793488:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787430904.793556:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.793728:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787430904.793784:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856171520 00000100:00100000:0.0:1787430904.793791:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856171520 00000100:00100000:0.0:1787430904.793872:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787430904.793883:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:15055:x1874256856171520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430904.793912:0:14368:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787430904.793915:0:14368:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787430904.793927:0:14368:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787430904.807324:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:15055:x1874256856171520:12345-0@lo:253:mount.lustre.0 Request processed in 13435us (13758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.807412:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787430904.807432:0:15055:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787430904.807436:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430904.807437:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430904.807439:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430904.807440:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430904.807441:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430904.807443:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430904.807444:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430904.807460:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430904.807461:0:15055:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787430904.807486:0:15055:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0f2fe8a8000 from lustre-OST0000 10000000:01000000:2.0:1787430904.807511:0:15055:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787430904.807514:0:15055:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787430904.807521:0:15055:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0f2ed3299b8 local copy 00010000:00010000:2.0:1787430904.807534:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430904.807767:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787430904.812902:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430904.813052:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.813163:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430904.813210:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856171648 00000100:00100000:3.0:1787430904.813218:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856171648 00000100:00100000:3.0:1787430904.813302:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787430904.813312:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:15055:x1874256856171648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430904.813559:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:15055:x1874256856171648:12345-0@lo:501:mount.lustre.0 Request processed in 248us (507us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430904.813567:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787430904.813664:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171648:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787430904.813694:0:15055:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787430904.813865:0:15055:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787430904.813874:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.813886:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430904.813911:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0f2fe8a8000 10000000:01000000:0.0:1787430904.813916:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787430904.814052:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0f2ed3299b8 10000000:01000000:0.0:1787430904.814062:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787430904.814066:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0f2ed3299b8 from 1 10000000:01000000:0.0:1787430904.814069:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787430904.814096:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.814105:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.814114:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430904.814128:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430904.814158:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.814552:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d2077900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430904.814624:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856171776 00000100:00100000:2.0:1787430904.814629:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856171776 00000100:00100000:2.0:1787430904.814658:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787430904.814665:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+12:15055:x1874256856171776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430904.814683:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430904.814698:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e69eaa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69ea3 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.814720:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e69eaa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69ea3 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.814730:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74600/0x1fa5b1e070e69eaa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69ea3 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.814748:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74600, rc 0) 00000100:00100000:2.0:1787430904.814788:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+13:15055:x1874256856171776:12345-0@lo:101:mount.lustre.0 Request processed in 123us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.814795:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787430904.815267:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430904.815281:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69eaa expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.815291:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69eaa expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430904.815308:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787430904.815351:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69eaa expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.815361:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262600/0x1fa5b1e070e69ea3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69eaa expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430904.815368:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787430904.815397:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787430904.815402:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787430904.815404:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787430904.815424:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.815432:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.815438:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430904.816436:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787430904.816489:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.816524:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d2077900 going to sleep for 11 seconds 00000100:00100000:2.0:1787430904.816628:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856171904 00000100:00100000:2.0:1787430904.816634:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856171904 00000100:00100000:2.0:1787430904.816665:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787430904.816692:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+13:15055:x1874256856171904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430904.816702:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430904.816715:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e69eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69eb1 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.816734:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e69eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69eb1 expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.816754:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75800/0x1fa5b1e070e69eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69eb1 expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.816763:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75800, rc 0) 00000100:00100000:2.0:1787430904.816795:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856171904:12345-0@lo:101:mount.lustre.0 Request processed in 123us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.816917:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787430904.818756:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856171904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430904.818778:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69eb8 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.818791:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69eb8 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430904.821297:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787430904.826170:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430904.827126:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787430904.827285:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787430904.827322:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787430904.827407:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787430904.827517:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787430904.827552:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787430904.827598:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787430904.827603:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787430904.827724:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430904.827805:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430904.827915:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430904.828029:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172032 00000100:00100000:2.0:1787430904.828036:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172032 00000100:00100000:2.0:1787430904.828127:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787430904.828138:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430904.828507:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172032:12345-0@lo:501:mount.lustre.0 Request processed in 368us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.828514:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787430904.828607:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430904.828653:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430904.828694:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430904.828895:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430904.829011:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172160 00000100:00100000:3.0:1787430904.829017:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172160 00000100:00100000:3.0:1787430904.829042:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787430904.829049:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430904.829457:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172160:12345-0@lo:503:mount.lustre.0 Request processed in 407us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.829464:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787430904.829807:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172160:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787430904.830486:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430904.830555:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430904.830613:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430904.830715:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787430904.830781:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172288 00000100:00100000:3.0:1787430904.830787:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172288 00000100:00100000:3.0:1787430904.830867:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787430904.830876:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430904.831160:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172288:12345-0@lo:502:mount.lustre.0 Request processed in 284us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.831167:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787430904.831238:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430904.831488:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787430904.831532:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787430904.831585:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787430904.831649:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787430904.831685:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787430904.831717:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787430904.831778:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787430904.831814:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787430904.831848:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787430904.831896:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787430904.832013:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787430904.832066:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787430904.832098:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430904.832145:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430904.832547:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fece5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430904.832623:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172416 00000100:00100000:2.0:1787430904.832629:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172416 00000100:00100000:2.0:1787430904.832662:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787430904.832671:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430904.832861:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172416:12345-0@lo:502:mount.lustre.0 Request processed in 191us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.832868:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787430904.833065:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430904.833135:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787430904.833146:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787430904.834216:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787430904.834224:0:15069:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787430904.834230:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.834232:0:15069:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787430904.834238:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787430904.834252:0:15069:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0f2c7f599b8) 00000020:00000080:1.0:1787430904.834272:0:15069:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787430904.834276:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787430904.834420:0:15069:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f2fe8a8000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787430904.834427:0:15069:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787430904.834434:0:15069:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1fa5b1e070e69ec6 00010000:00010000:1.0:1787430904.838188:0:15069:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787430904.839109:0:15069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787430904.841192:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787430904.842638:0:15069:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787430904.842656:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430904.842662:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.842665:0:15069:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787430904.842668:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787430904.842671:0:15069:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787430904.842672:0:15069:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430904.842674:0:15069:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787430904.842675:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787430904.842678:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.842680:0:15069:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787430904.842682:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430904.842685:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.842686:0:15069:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787430904.842689:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430904.842691:0:15069:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787430904.842693:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430904.842695:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.842696:0:15069:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787430904.842698:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430904.842700:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.842701:0:15069:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787430904.842704:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787430904.842769:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430904.842773:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430904.842774:0:15069:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787430904.842778:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787430904.849881:0:15055:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787430904.849938:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787430904.850086:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69eb8 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850099:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5262000/0x1fa5b1e070e69eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69eb8 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430904.850108:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2fe8a8000 from 1 10000000:01000000:2.0:1787430904.850111:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430904.850155:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850163:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850173:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430904.850199:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430904.850264:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.850313:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172544 00000100:00100000:2.0:1787430904.850319:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172544 00000100:00100000:2.0:1787430904.850383:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430904.850391:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+14:15055:x1874256856172544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430904.850420:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430904.850433:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69ecd expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850456:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850465:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850475:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74200, rc 0) 00000100:00100000:2.0:1787430904.850506:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172544:12345-0@lo:101:mount.lustre.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.850513:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787430904.850557:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430904.850576:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430904.850593:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.850603:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430904.851243:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787430904.851685:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430904.852139:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787430904.852186:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787430904.852252:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787430904.852261:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787430904.852344:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430904.852403:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.852439:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430904.852545:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172672 00000100:00100000:0.0:1787430904.852551:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172672 00000100:00100000:0.0:1787430904.852585:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787430904.852594:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430904.852802:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172672:12345-0@lo:501:mount.lustre.0 Request processed in 209us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430904.852810:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787430904.855076:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430904.855132:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430904.855199:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.855243:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430904.855462:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172800 00000100:00100000:3.0:1787430904.855469:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172800 00000100:00100000:3.0:1787430904.855514:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787430904.855523:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787430904.855699:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172800:12345-0@lo:503:mount.lustre.0 Request processed in 176us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.855707:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787430904.855818:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787430904.857905:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430904.858137:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430904.858210:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.858310:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430904.858562:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856172928 00000100:00100000:0.0:1787430904.858568:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856172928 00000100:00100000:0.0:1787430904.858710:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787430904.858721:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430904.858931:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856172928:12345-0@lo:502:mount.lustre.0 Request processed in 211us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430904.858939:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787430904.859095:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856172928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430904.859378:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787430904.859427:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787430904.859502:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787430904.859542:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787430904.859573:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787430904.859626:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787430904.859659:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787430904.859687:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787430904.859717:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430904.859766:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.860467:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430904.860556:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173056 00000100:00100000:3.0:1787430904.860563:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173056 00000100:00100000:3.0:1787430904.860599:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787430904.860618:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856173056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430904.860830:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856173056:12345-0@lo:502:mount.lustre.0 Request processed in 221us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.860846:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787430904.861072:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430904.861201:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787430904.861221:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787430904.862164:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430904.862175:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430904.862177:0:15073:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787430904.862184:0:15073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2fe8a8000 00000020:00000080:2.0:1787430904.862186:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430904.862193:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430904.862195:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430904.862196:0:15073:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787430904.862199:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430904.862201:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430904.862203:0:15073:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787430904.862206:0:15073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2fe8a8000 00000020:00000080:2.0:1787430904.862208:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430904.862261:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430904.862264:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430904.862266:0:15073:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787430904.862269:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787430904.862272:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430904.862273:0:15073:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787430904.862276:0:15073:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0f2fe8a8000 00000020:00000080:2.0:1787430904.862278:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787430904.862310:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787430904.862314:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787430904.862315:0:15073:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787430904.862318:0:15073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787430904.866440:0:15055:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787430904.866480:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430904.866499:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430904.866512:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430904.866584:0:15055:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787430904.866587:0:15055:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0f2fe8a8000 10000000:01000000:3.0:1787430904.866590:0:15055:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0f2fe8a8000 10000000:01000000:3.0:1787430904.866594:0:15055:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430904.866601:0:15055:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2fe8a8000 from 1 10000000:01000000:3.0:1787430904.866603:0:15055:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787430904.866767:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430904.866777:0:15055:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430904.866788:0:15055:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430904.866812:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787430904.866879:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430904.866962:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787430904.869177:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173184 00000100:00100000:2.0:1787430904.869189:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173184 00000100:00100000:2.0:1787430904.869239:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787430904.869248:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856173184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787430904.869265:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430904.869282:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74000/0x1fa5b1e070e69ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69edb expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.869317:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74000/0x1fa5b1e070e69ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69edb expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.869342:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74000/0x1fa5b1e070e69ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69edb expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.869351:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74000, rc 0) 00000100:00100000:2.0:1787430904.869426:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173184:12345-0@lo:101:mount.lustre.0 Request processed in 179us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430904.869432:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787430904.869445:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430904.869461:0:15055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69ee2 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430904.869476:0:15055:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69ee2 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430904.870418:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787430904.870900:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787430904.871229:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787430904.871274:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787430904.871308:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787430904.872806:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787430904.872865:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787430904.872927:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787430904.873048:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787430904.873084:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787430904.873132:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787430904.873166:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787430904.873200:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787430904.873248:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787430904.873282:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787430904.873315:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787430904.873387:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787430904.873565:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787430904.875544:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787430904.875721:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787430904.875772:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787430904.875803:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787430904.875846:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787430904.875879:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787430904.875907:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787430904.876712:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787430904.876781:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787430904.876812:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787430904.876871:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787430904.876905:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787430904.877067:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787430904.877075:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787430904.877173:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430904.877239:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430904.877346:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf09d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430904.886080:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173312 00000100:00100000:1.0:1787430904.886094:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173312 00000100:00100000:1.0:1787430904.886168:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787430904.886178:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430904.886506:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173312:12345-0@lo:501:mount.lustre.0 Request processed in 328us (9265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430904.886514:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787430904.887765:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430904.887818:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430904.887871:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.887912:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a14600 going to sleep for 11 seconds 00000100:00100000:1.0:1787430904.888728:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173440 00000100:00100000:1.0:1787430904.888746:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173440 00000100:00100000:1.0:1787430904.888795:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787430904.888803:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430904.889153:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173440:12345-0@lo:503:mount.lustre.0 Request processed in 349us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430904.889163:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787430904.892400:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787430904.893229:0:15055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430904.893307:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430904.893417:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.893460:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a14600 going to sleep for 11 seconds 00000100:00100000:1.0:1787430904.893531:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173568 00000100:00100000:1.0:1787430904.893538:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173568 00000100:00100000:1.0:1787430904.893586:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787430904.893595:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430904.893819:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173568:12345-0@lo:502:mount.lustre.0 Request processed in 223us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430904.893827:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787430904.894160:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430904.894438:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787430904.894488:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787430904.894524:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787430904.894570:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787430904.894673:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787430904.894732:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787430904.894781:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787430904.894811:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787430904.894854:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787430904.894886:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787430904.894930:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787430904.895058:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787430904.895094:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787430904.895124:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787430904.895169:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787430904.895202:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787430904.895232:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787430904.895289:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787430904.895321:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787430904.895377:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787430904.895419:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787430904.895451:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787430904.895479:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787430904.895519:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787430904.895550:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787430904.895579:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787430904.895899:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787430904.895939:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787430904.896055:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787430904.896102:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787430904.896138:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787430904.896171:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787430904.896200:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787430904.896263:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787430904.896299:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787430904.896661:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787430904.896703:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787430904.896752:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787430904.896817:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787430904.896856:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787430904.896904:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430904.897057:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.897113:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a14600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430904.897239:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173696 00000100:00100000:3.0:1787430904.897246:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173696 00000100:00100000:3.0:1787430904.897294:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787430904.897304:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787430904.897537:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173696:12345-0@lo:502:mount.lustre.0 Request processed in 234us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430904.897545:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787430904.897764:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430904.897834:0:15055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787430904.897844:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787430904.898865:0:15078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787430904.898880:0:15078:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0f2ec254d28) 00000020:00000080:0.0:1787430904.898904:0:15078:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787430904.899068:0:15078:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f2fe8a8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787430904.899073:0:15078:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f2fe8a8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787430904.899076:0:15078:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2fe8a8000 3 00010000:00080000:0.0:1787430904.899105:0:15078:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f1c6902800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787430904.902977:0:15078:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787430904.904685:0:15078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787430904.904723:0:15078:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787430904.904747:0:15078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1fa5b1e070e69ef0 00000100:00080000:0.0:1787430904.904759:0:15078:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787430904.904765:0:15078:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0f1c6902800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787430904.904800:0:15078:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f2c35fc000 x1874256856173824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430904.904842:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1874256856173824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787430904.904910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.904985:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173824 00000100:00100000:0.0:1787430904.904993:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173824 00000100:00100000:0.0:1787430904.905022:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430904.905029:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874256856173824:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787430904.905051:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 368 last 0 00000020:00000080:0.0:1787430904.905079:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1fa5b1e070e69ef7 00000004:00100000:0.0:1787430904.905100:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787430904.905127:0:14377:0:(import.c:65:import_set_state_nolock()) ffffa0f1c6904800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430904.905175:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874256856173824:12345-0@lo:38:llog_process_th.0 Request processed in 145us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430904.905182:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787430904.905218:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0f2c35fc000 x1874256856173824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430904.905227:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787430904.905234:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787430904.905240:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787430904.905244:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787430904.905246:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f1c6902800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787430904.905251:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1874256856173824:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787430904.905266:0:15078:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787430904.910783:0:15078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787430904.911034:0:15055:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787430904.911061:0:15055:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787430904.911083:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69ee2 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430904.911094:0:15055:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a600/0x1fa5b1e070e69edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69ee2 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787430904.911141:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787430904.911143:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430904.911145:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430904.911146:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430904.911148:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430904.911149:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430904.911151:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430904.911152:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430904.911154:0:15055:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787430904.911158:0:15055:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787430904.911161:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787430904.911162:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430904.911163:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430904.911169:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430904.911170:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430904.911171:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430904.911172:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430904.911173:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430904.911174:0:15055:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787430904.911201:0:15055:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787430904.911220:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787430904.911286:0:15055:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430904.911538:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430904.911660:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856173952 00000100:00100000:0.0:1787430904.911667:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856173952 00000100:00100000:0.0:1787430904.911712:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787430904.911722:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15055:x1874256856173952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430904.911760:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787430904.911774:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787430904.935963:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787430904.935977:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787430904.936005:0:14391:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787430904.936009:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787430904.936031:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430904.936050:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 16 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430904.936059:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430904.936097:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 16 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430904.936129:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 16 pid: 14370 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430904.936143:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14391:1874256856174080:0@lo:104: 00000100:00100000:1.0:1787430904.936209:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430904.936246:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f4044d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787430904.936282:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174080 00000100:00100000:1.0:1787430904.936288:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174080 00000100:00100000:1.0:1787430904.936361:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430904.936370:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14391:x1874256856174080:12345-0@lo:104: 00010000:00010000:1.0:1787430904.936382:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430904.936427:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787430904.936433:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14391:x1874256856174080:12345-0@lo:104: Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430904.936440:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430904.936490:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14391:1874256856174080:0@lo:104: 00010000:00010000:1.0:1787430904.936507:0:14391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.936776:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430904.936785:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.936795:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:0.0:1787430904.936799:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.936816:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787430904.936823:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430904.936829:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787430904.936863:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.936869:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787430904.936894:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.936901:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c147bc00/0x1fa5b1e070e69e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e6b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.936924:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430904.936926:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430904.936928:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430904.936939:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430904.936950:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856174208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787430904.936981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430904.937016:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174208 00000100:00100000:0.0:1787430904.937020:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174208 00010000:00010000:0.0:1787430904.937040:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 17 pid: 14370 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430904.937061:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430904.937075:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:3309:x1874256856174208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430904.937086:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430904.937091:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 17 pid: 14370 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937102:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 17 pid: 14370 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937115:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e69e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69e64 expref: 17 pid: 14370 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937127:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937134:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787430904.937147:0:14360:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007378538s 00010000:00010000:0.0:1787430904.937151:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937158:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937165:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937171:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937176:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430904.937186:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937193:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937207:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937217:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430904.937246:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:3309:x1874256856174208:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430904.937252:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430904.937282:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856174208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430904.937296:0:14391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937302:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430904.937309:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4c00/0x1fa5b1e070e69efe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430904.944938:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15055:1874256856173952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787430904.944956:0:15055:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787430904.944959:0:15055:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430904.944961:0:15055:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787430904.944962:0:15055:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430904.944963:0:15055:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430904.944964:0:15055:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430904.944966:0:15055:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430904.944967:0:15055:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430904.944969:0:15055:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430904.944971:0:15055:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787430904.944985:0:15055:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787430904.945164:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:15055:x1874256856173952:12345-0@lo:253:mount.lustre.0 Request processed in 33183us (33617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430904.945177:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00080000:10000000:2.0:1787430904.948656:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787430904.948831:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787430904.949005:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787430904.949163:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787430904.949320:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787430904.950432:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787430904.951407:0:15055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787430904.988864:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787430905.019810:0:15055:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787430905.019820:0:15055:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787430905.019852:0:15055:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787430905.019948:0:15055:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787430905.019966:0:15055:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787430905.020004:0:15055:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787430906.012857:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787430906.269868:0:14372:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787430906.269876:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f1c733e800 from 7 10000000:01000000:2.0:1787430906.269881:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787430906.269939:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430906.269952:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430906.269964:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430906.269990:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856174336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787430906.270058:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430906.270115:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430906.270649:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174336 00000100:00100000:1.0:1787430906.270658:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174336 00000100:00100000:1.0:1787430906.270728:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787430906.270747:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+15:14372:x1874256856174336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787430906.270761:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430906.270776:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69f05 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430906.270799:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 16 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430906.270809:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 16 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430906.270818:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a4800, rc 0) 00000100:00100000:1.0:1787430906.270866:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:14372:x1874256856174336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430906.271581:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856174336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430906.271600:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430906.271610:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430906.271668:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856174464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787430906.271722:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430906.271754:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858540 going to sleep for 11 seconds 00000100:00100000:0.0:1787430906.273424:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174464 00000100:00100000:0.0:1787430906.273438:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174464 00000100:00100000:1.0:1787430906.273559:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787430906.273948:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787430906.273962:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:14372:x1874256856174464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787430906.273986:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787430906.274002:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787430906.274009:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787430906.274763:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:14372:x1874256856174464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 803us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430906.274772:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787430906.275102:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856174464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787430906.275172:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787430906.275182:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430906.275254:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430907.038620:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787430907.293459:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787430908.062011:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430909.084542:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787430909.848755:0:15423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787430910.108641:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787430910.173118:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430910.173124:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787430910.173127:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787430910.173130:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787430910.173179:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856174720:0@lo:400:kworker.0 00000100:00100000:0.0:1787430910.173248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430910.173308:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787430910.173315:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856174592:0@lo:400:kworker.0 00000100:00100000:0.0:1787430910.173367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430910.173397:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856174848:0@lo:400:kworker.0 00000100:00100000:0.0:1787430910.173419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430910.173465:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174720 00000100:00100000:0.0:1787430910.173473:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174720 00000100:00100000:0.0:1787430910.173519:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174848 00000100:00100000:0.0:1787430910.173523:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174848 00000100:00100000:0.0:1787430910.173550:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430910.173565:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856174720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430910.173628:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874256856174720:12345-0@lo:400:kworker.0 Request processed in 52us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430910.173645:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430910.173660:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787430910.173682:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856174848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430910.173720:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874256856174848:12345-0@lo:400:kworker.0 Request processed in 41us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430910.173727:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430910.173936:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174592 00000100:00100000:1.0:1787430910.173941:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174592 00000100:00100000:1.0:1787430910.173974:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787430910.173989:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:3308:x1874256856174592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430910.174024:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:3308:x1874256856174592:12345-0@lo:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430910.174030:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787430910.174854:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787430910.177029:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2c35ff480 x1874256856174848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430910.177048:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1874256856174848:0@lo:400:kworker.0 00000100:00100000:1.0:1787430910.177706:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856174592:0@lo:400:kworker.0 00010000:00080000:1.0:1787430910.177735:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f2c35fc700 x1874256856174720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430910.177745:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874256856174720:0@lo:400:kworker.0 00010000:00010000:2.0:1787430911.133210:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430912.158723:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430913.181099:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430914.206454:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787430915.216858:0:15772:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787430915.216863:0:15772:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787430915.216996:0:15772:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0f2ec24b800 00000020:01000004:2.0:1787430915.217015:0:15772:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787430915.217030:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787430915.217045:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0f2c3ec99b8) 00000020:00000080:2.0:1787430915.217062:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787430915.229371:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787430915.234088:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787430915.235194:0:15772:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787430915.236440:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787430915.237219:0:15772:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787430915.237664:0:15772:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787430915.238523:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1787430915.238837:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1787430915.238933:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1787430915.239693:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1787430915.240157:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 642: rc = 0 00100000:10000000:3.0:1787430915.240494:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1787430915.240958:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 642: rc = 0 00100000:10000000:3.0:1787430915.241202:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1787430915.241561:0:15772:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 642: rc = 0 00000020:00000080:3.0:1787430915.242420:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787430915.242432:0:15772:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787430915.242445:0:15772:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1fa5b1e070e69f1a 00000020:01000004:3.0:1787430915.242453:0:15772:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787430915.242476:0:15772:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787430915.242479:0:15772:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787430915.242486:0:15772:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787430915.242506:0:15772:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787430915.242510:0:15772:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787430915.254054:0:15772:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787430915.254092:0:15772:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.160@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787430915.254096:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787430915.254098:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430915.254100:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430915.254101:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430915.254102:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430915.254104:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430915.254105:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430915.254107:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430915.254108:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430915.254111:0:15772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787430915.254113:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787430915.254114:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430915.254116:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430915.254117:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430915.254118:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430915.254119:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430915.254125:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430915.254126:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430915.254127:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787430915.254165:0:15772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787430915.254185:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856174976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787430915.254258:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430915.254310:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430915.254551:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856174976 00000100:00100000:0.0:1787430915.254559:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856174976 00000100:00100000:0.0:1787430915.254624:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787430915.254634:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15772:x1874256856174976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430915.254663:0:14370:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787430915.254666:0:14370:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787430915.254670:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787430915.268752:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15772:x1874256856174976:12345-0@lo:253:mount.lustre.0 Request processed in 14111us (14484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.268767:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787430915.268872:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856174976:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787430915.268888:0:15772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787430915.268891:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787430915.268893:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787430915.268895:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787430915.268896:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787430915.268897:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787430915.268899:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787430915.268911:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787430915.268913:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787430915.268914:0:15772:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787430915.268935:0:15772:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0f2ec24b800 from lustre-OST0001 10000000:01000000:3.0:1787430915.268959:0:15772:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787430915.268962:0:15772:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787430915.268970:0:15772:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0f2ed3299b8 local copy 00010000:00010000:3.0:1787430915.268980:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430915.269440:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787430915.269480:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430915.269570:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d0e28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.269604:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175104 00000100:00100000:1.0:1787430915.269610:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175104 00000100:00100000:1.0:1787430915.269703:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787430915.269713:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15772:x1874256856175104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430915.269903:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15772:x1874256856175104:12345-0@lo:501:mount.lustre.0 Request processed in 192us (422us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430915.269910:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787430915.269929:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175104:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787430915.269942:0:15772:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787430915.270078:0:15772:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787430915.270090:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.270097:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263e00/0x1fa5b1e070e69d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69d92 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430915.270113:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0f2ec24b800 10000000:01000000:3.0:1787430915.270116:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787430915.270120:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787430915.270121:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430915.270124:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787430915.270126:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787430915.270144:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.270149:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.270156:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430915.270163:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787430915.270182:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430915.270200:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d0e28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787430915.270284:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175232 00000100:00100000:0.0:1787430915.270287:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175232 00000100:00100000:0.0:1787430915.270310:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787430915.270314:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:15772:x1874256856175232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430915.270320:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430915.270349:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c5263600/0x1fa5b1e070e69f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69f21 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.270368:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c5263600/0x1fa5b1e070e69f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f21 expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.270384:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c5263600/0x1fa5b1e070e69f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f21 expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.270395:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263600, rc 0) 00000100:00100000:0.0:1787430915.270427:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175232:12345-0@lo:101:mount.lustre.0 Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.270433:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787430915.270550:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430915.270562:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f28 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.270570:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69f28 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787430915.271166:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787430915.271994:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430915.272398:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787430915.272499:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787430915.272553:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787430915.272589:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787430915.272608:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787430915.272631:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787430915.272695:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787430915.272704:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787430915.272776:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430915.272823:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430915.272859:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5721780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.272881:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175360 00000100:00100000:1.0:1787430915.272888:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175360 00000100:00100000:1.0:1787430915.272936:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787430915.272943:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430915.273247:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175360:12345-0@lo:501:mount.lustre.0 Request processed in 302us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.273254:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787430915.273283:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430915.273311:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787430915.273424:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430915.273443:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5721780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.273511:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175488 00000100:00100000:1.0:1787430915.273521:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175488 00000100:00100000:1.0:1787430915.273593:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787430915.273600:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430915.273875:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175488:12345-0@lo:503:mount.lustre.0 Request processed in 274us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.273882:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787430915.273973:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787430915.275150:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787430915.275777:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430915.275842:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430915.275976:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175616 00000100:00100000:0.0:1787430915.275983:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175616 00000100:00100000:0.0:1787430915.276028:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787430915.276038:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430915.276276:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175616:12345-0@lo:502:mount.lustre.0 Request processed in 239us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.276284:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787430915.276397:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5721780 going to sleep for 11 seconds 00000100:00100000:2.0:1787430915.276416:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430915.276748:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787430915.276805:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787430915.276839:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787430915.276887:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787430915.276937:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787430915.276968:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787430915.277013:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787430915.277049:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787430915.277102:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787430915.277133:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787430915.277176:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430915.277204:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5721780 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.277347:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175744 00000100:00100000:1.0:1787430915.277352:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175744 00000100:00100000:1.0:1787430915.277388:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787430915.277396:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430915.277563:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856175744:12345-0@lo:502:mount.lustre.0 Request processed in 167us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.277570:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787430915.277745:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856175744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430915.277806:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787430915.277815:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787430915.278977:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787430915.278986:0:15773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787430915.278993:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787430915.278995:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787430915.279000:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787430915.279015:0:15773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0f2ec2519b8) 00000020:00000080:0.0:1787430915.279039:0:15773:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787430915.279045:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787430915.279101:0:15773:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f2ec24b800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787430915.279108:0:15773:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787430915.279114:0:15773:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1fa5b1e070e69f36 00010000:00010000:1.0:1787430915.286080:0:15773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787430915.286599:0:15773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787430915.288147:0:15773:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787430915.289494:0:15773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787430915.289506:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430915.289513:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430915.289515:0:15773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787430915.289518:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430915.289522:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430915.289523:0:15773:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787430915.289526:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787430915.289528:0:15773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787430915.289542:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430915.289545:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430915.289546:0:15773:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787430915.289548:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787430915.289557:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430915.289558:0:15773:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787430915.289562:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787430915.289611:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787430915.289615:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787430915.289616:0:15773:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787430915.289619:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000100:00080000:1.0:1787430915.294162:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430915.294172:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787430915.294175:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430915.294178:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787430915.294267:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856176000:0@lo:400:kworker.0 00000100:00100000:1.0:1787430915.294367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.294417:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176000 00000100:00100000:1.0:1787430915.294424:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176000 00000100:00100000:1.0:1787430915.294476:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430915.294485:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856176000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430915.294547:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856176000:12345-0@lo:400:kworker.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.294554:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787430915.294574:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787430915.294601:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f1c6ee2d80 x1874256856176000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430915.294613:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856176000:0@lo:400:kworker.0 00000100:00100000:3.0:1787430915.294676:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856175872:0@lo:400:kworker.0 00000100:00100000:3.0:1787430915.294707:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.294772:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856175872 00000100:00100000:1.0:1787430915.294777:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856175872 00000020:01000000:2.0:1787430915.295220:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787430915.295253:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787430915.295268:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f28 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430915.295280:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a400/0x1fa5b1e070e69f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f28 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430915.295289:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2ec24b800 from 1 10000000:01000000:2.0:1787430915.295291:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787430915.295315:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430915.295323:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430915.295400:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430915.295414:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787430915.295447:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430915.295470:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c57213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.295546:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430915.295564:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856175872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430915.295612:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856175872:12345-0@lo:400:kworker.0 Request processed in 52us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.295619:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787430915.295676:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f1c6ee0e00 x1874256856175872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787430915.295688:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856175872:0@lo:400:kworker.0 00000100:00100000:3.0:1787430915.297157:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176128 00000100:00100000:3.0:1787430915.297168:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176128 00000100:00100000:3.0:1787430915.297221:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787430915.297232:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:15772:x1874256856176128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787430915.297247:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430915.297266:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69f3d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.297296:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.297308:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.297319:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a000, rc 0) 00000100:00100000:3.0:1787430915.297427:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176128:12345-0@lo:101:mount.lustre.0 Request processed in 198us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.297517:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787430915.297544:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.297564:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430915.297570:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000040:00080000:0.0:1787430915.298294:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787430915.299238:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787430915.301611:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787430915.301712:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787430915.301794:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787430915.301803:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787430915.301927:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430915.301988:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430915.302036:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.302100:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176256 00000100:00100000:1.0:1787430915.302108:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176256 00000100:00100000:1.0:1787430915.302160:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787430915.302178:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430915.302455:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176256:12345-0@lo:501:mount.lustre.0 Request processed in 277us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.302463:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787430915.302502:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787430915.302544:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430915.302584:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430915.302612:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.302688:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176384 00000100:00100000:1.0:1787430915.302692:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176384 00000100:00100000:1.0:1787430915.302714:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787430915.302721:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430915.302941:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176384:12345-0@lo:503:mount.lustre.0 Request processed in 219us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.302948:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787430915.303114:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787430915.303586:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787430915.303662:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430915.303705:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430915.303724:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.304010:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176512 00000100:00100000:1.0:1787430915.304016:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176512 00000100:00100000:1.0:1787430915.304102:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787430915.304110:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430915.304309:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176512:12345-0@lo:502:mount.lustre.0 Request processed in 200us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.304316:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787430915.304493:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787430915.304723:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787430915.304789:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787430915.304841:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787430915.304888:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787430915.305152:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787430915.305206:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787430915.305244:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787430915.305277:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787430915.305310:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430915.305767:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430915.305845:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.306014:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176640 00000100:00100000:1.0:1787430915.306029:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176640 00000100:00100000:1.0:1787430915.306105:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787430915.306114:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430915.306304:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176640:12345-0@lo:502:mount.lustre.0 Request processed in 191us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.306311:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787430915.306437:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787430915.306549:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787430915.306561:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787430915.307436:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430915.307445:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430915.307448:0:15778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787430915.307454:0:15778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2ec24b800 00000020:00000080:3.0:1787430915.307456:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430915.307469:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430915.307472:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430915.307473:0:15778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787430915.307475:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430915.307477:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430915.307479:0:15778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787430915.307482:0:15778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0f2ec24b800 00000020:00000080:3.0:1787430915.307484:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430915.307555:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430915.309603:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430915.309609:0:15778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787430915.310754:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787430915.310764:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430915.310766:0:15778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787430915.310773:0:15778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0f2ec24b800 00000020:00000080:3.0:1787430915.310776:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787430915.310990:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787430915.310995:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787430915.310997:0:15778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787430915.311001:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787430915.311121:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787430915.311148:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430915.311166:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.311178:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430915.311221:0:15772:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787430915.311224:0:15772:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0f2ec24b800 10000000:01000000:3.0:1787430915.311227:0:15772:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0f2ec24b800 10000000:01000000:3.0:1787430915.311230:0:15772:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787430915.311236:0:15772:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0f2ec24b800 from 1 10000000:01000000:3.0:1787430915.311246:0:15772:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787430915.311284:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.311294:0:15772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.311304:0:15772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430915.311349:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787430915.311430:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430915.311519:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a0cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430915.311609:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176768 00000100:00100000:1.0:1787430915.311617:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176768 00000100:00100000:1.0:1787430915.311666:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787430915.311676:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856176768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430915.311688:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430915.311701:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c59a5c00/0x1fa5b1e070e69f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69f4b expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.311724:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c59a5c00/0x1fa5b1e070e69f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f4b expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.311735:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c59a5c00/0x1fa5b1e070e69f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f4b expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.311744:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c59a5c00, rc 0) 00000100:00100000:1.0:1787430915.311788:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856176768:12345-0@lo:101:mount.lustre.0 Request processed in 112us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.311795:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787430915.311868:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787430915.311883:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f52 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.311975:0:15772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69f52 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430915.312598:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787430915.315071:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787430915.316477:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787430915.316560:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787430915.316597:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787430915.316644:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787430915.316681:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787430915.316733:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787430915.316771:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787430915.316804:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787430915.316853:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787430915.316891:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787430915.317277:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787430915.317359:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787430915.317398:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787430915.317434:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787430915.317494:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787430915.317543:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787430915.317579:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787430915.317982:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787430915.318027:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787430915.318062:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787430915.318111:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787430915.318147:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787430915.318180:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787430915.318228:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787430915.318265:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787430915.318299:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787430915.318406:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787430915.318443:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787430915.318477:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787430915.318526:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787430915.318574:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787430915.318608:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787430915.318641:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787430915.318689:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787430915.318724:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787430915.318768:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787430915.318803:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787430915.318897:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787430915.319030:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787430915.319129:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430915.319196:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.319289:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430915.325433:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856176896 00000100:00100000:2.0:1787430915.325449:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856176896 00000100:00100000:2.0:1787430915.325516:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787430915.325542:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856176896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787430915.325864:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856176896:12345-0@lo:501:mount.lustre.0 Request processed in 336us (6667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430915.325871:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787430915.326662:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856176896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787430915.326715:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787430915.326767:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.326809:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430915.329803:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177024 00000100:00100000:0.0:1787430915.329818:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177024 00000100:00100000:0.0:1787430915.329876:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787430915.329887:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787430915.330202:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177024:12345-0@lo:503:mount.lustre.0 Request processed in 317us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.330211:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787430915.331449:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787430915.334273:0:15772:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787430915.334399:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430915.334479:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.334541:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430915.334569:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177152 00000100:00100000:0.0:1787430915.334577:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177152 00000100:00100000:0.0:1787430915.334639:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787430915.334649:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430915.335227:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177152:12345-0@lo:502:mount.lustre.0 Request processed in 577us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.335236:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787430915.335254:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430915.335757:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787430915.336004:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787430915.336047:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787430915.336099:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787430915.336137:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787430915.336188:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787430915.336225:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787430915.336258:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787430915.336321:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787430915.336387:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787430915.336419:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787430915.336465:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787430915.336501:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787430915.337025:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787430915.337084:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787430915.337118:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787430915.337146:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787430915.337267:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787430915.337382:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787430915.337420:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787430915.337468:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787430915.337504:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787430915.337556:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787430915.337770:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787430915.337810:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787430915.337923:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787430915.337976:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787430915.338012:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787430915.338041:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787430915.338085:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787430915.338122:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787430915.338153:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787430915.338266:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787430915.338425:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787430915.338472:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787430915.338521:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787430915.338570:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787430915.338725:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787430915.338789:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787430915.338893:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787430915.338944:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787430915.339018:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.339063:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787430915.339475:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177280 00000100:00100000:0.0:1787430915.339482:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177280 00000100:00100000:0.0:1787430915.339538:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787430915.339548:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787430915.339779:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177280:12345-0@lo:502:mount.lustre.0 Request processed in 231us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430915.339793:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787430915.339877:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787430915.339949:0:15772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787430915.339958:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787430915.342890:0:15783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787430915.342918:0:15783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0f1c4d119b8) 00000020:00000080:2.0:1787430915.342941:0:15783:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787430915.343018:0:15783:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0f2ec24b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787430915.343028:0:15783:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0f2ec24b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787430915.343031:0:15783:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0f2ec24b800 3 00010000:00080000:2.0:1787430915.343066:0:15783:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0f2fe473000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787430915.345267:0:15783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787430915.347086:0:15783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787430915.347129:0:15783:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787430915.347141:0:15783:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1fa5b1e070e69f60 00000100:00080000:3.0:1787430915.347152:0:15783:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787430915.347157:0:15783:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0f2fe473000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787430915.347193:0:15783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c4c9ad80 x1874256856177408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787430915.347224:0:15783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787430915.347445:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430915.347450:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787430915.347453:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787430915.347455:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787430915.347751:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1874256856177408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787430915.347819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787430915.348079:0:15783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787430915.348208:0:15772:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787430915.348236:0:15772:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787430915.348258:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f52 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.348268:0:15772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b200/0x1fa5b1e070e69f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f52 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787430915.348309:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787430915.348311:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430915.348313:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430915.348314:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430915.348315:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430915.348317:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430915.348318:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430915.348320:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430915.348321:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430915.348355:0:15772:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787430915.348357:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787430915.348358:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787430915.348359:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787430915.348360:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787430915.348361:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787430915.348362:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787430915.348363:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787430915.348364:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787430915.348365:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787430915.348382:0:15772:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787430915.348395:0:15772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177536:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787430915.348443:0:15772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.348467:0:15772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430915.348669:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177408 00000100:00100000:2.0:1787430915.348676:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177408 00000100:00100000:2.0:1787430915.348742:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787430915.348750:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874256856177408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787430915.348770:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:2.0:1787430915.348799:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1fa5b1e070e69f67 00000004:00100000:2.0:1787430915.348813:0:14377:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787430915.348843:0:14377:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe470000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430915.348904:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874256856177408:12345-0@lo:38:llog_process_th.0 Request processed in 153us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430915.348911:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787430915.348975:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0f1c4c9ad80 x1874256856177408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787430925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430915.348985:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430915.348991:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787430915.348998:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787430915.349002:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787430915.349004:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe473000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787430915.349010:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1874256856177408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787430915.349166:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177536 00000100:00100000:0.0:1787430915.349171:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177536 00000100:00100000:0.0:1787430915.349395:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787430915.349405:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:15772:x1874256856177536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787430915.349427:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787430915.349442:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787430915.374779:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787430915.374803:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787430915.375094:0:14391:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787430915.375100:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787430915.375125:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.375143:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.375152:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.375192:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 19 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430915.375206:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 19 pid: 14368 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430915.375220:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14391:1874256856177664:0@lo:104: 00000100:00100000:0.0:1787430915.375284:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430915.375343:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28900 going to sleep for 11 seconds 00000100:00100000:3.0:1787430915.375612:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177664 00000100:00100000:3.0:1787430915.375619:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177664 00000100:00100000:3.0:1787430915.375675:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430915.375686:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14391:x1874256856177664:12345-0@lo:104: 00010000:00010000:3.0:1787430915.375717:0:14358:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.375787:0:14358:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787430915.375794:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:14391:x1874256856177664:12345-0@lo:104: Request processed in 111us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430915.375802:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787430915.376163:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14391:1874256856177664:0@lo:104: 00010000:00010000:2.0:1787430915.376184:0:14391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.376909:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430915.376919:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.376928:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75600 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:1.0:1787430915.376933:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.376942:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787430915.376957:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787430915.376963:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787430915.377001:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377007:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787430915.377038:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377043:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75600/0x1fa5b1e070e69f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69f0c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377057:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430915.377058:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430915.377060:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430915.377069:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856177792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430915.377120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430915.377292:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177792 00000100:00100000:1.0:1787430915.377298:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177792 00010000:00010000:1.0:1787430915.377321:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 20 pid: 14368 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430915.377368:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430915.377377:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+20:3308:x1874256856177792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787430915.377389:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430915.377393:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 20 pid: 14368 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377405:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 20 pid: 14368 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377577:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c59a4800/0x1fa5b1e070e69f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69f05 expref: 20 pid: 14368 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377593:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377601:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787430915.377614:0:14360:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007378538s 00010000:00010000:1.0:1787430915.377618:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377626:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377633:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377640:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377645:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430915.377649:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.377656:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.379222:0:14391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.379223:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430915.379242:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.379305:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c5263c00/0x1fa5b1e070e69f6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430915.379344:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430915.379423:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3308:x1874256856177792:12345-0@lo:103:ldlm_bl.0 Request processed in 2044us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430915.379433:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787430915.379454:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856177792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787430915.386311:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:15772:x1874256856177536:12345-0@lo:253:mount.lustre.0 Request processed in 36899us (37858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430915.386471:0:15772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec3bb70-eba8-428d-9804-5196e7d74be3:15772:1874256856177536:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787430915.386484:0:15772:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787430915.386486:0:15772:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787430915.386487:0:15772:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787430915.386488:0:15772:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787430915.386489:0:15772:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787430915.386501:0:15772:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787430915.386502:0:15772:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787430915.386503:0:15772:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787430915.386505:0:15772:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787430915.386506:0:15772:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787430915.386521:0:15772:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787430915.386570:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00080000:10000000:3.0:1787430915.391176:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430915.391669:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430915.392143:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430915.392298:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787430915.392617:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787430915.392892:0:15772:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787430915.393788:0:15772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787430915.440223:0:15772:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787430915.440234:0:15772:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787430915.440266:0:15772:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787430915.440367:0:15772:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787430915.440382:0:15772:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787430915.440410:0:15772:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787430916.252656:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787430917.148486:0:14372:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787430917.148507:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0f1c733e800 from 8 10000000:01000000:3.0:1787430917.148512:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787430917.148564:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430917.148596:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430917.148608:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430917.148635:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856177920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430917.148832:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430917.148895:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787430917.148935:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856177920 00000100:00100000:0.0:1787430917.148945:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856177920 00000100:00100000:0.0:1787430917.149009:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787430917.149019:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856177920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430917.149033:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430917.149048:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c5262200/0x1fa5b1e070e69f7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e69f75 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430917.149072:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c5262200/0x1fa5b1e070e69f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f75 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430917.149082:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c5262200/0x1fa5b1e070e69f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f75 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430917.149092:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262200, rc 0) 00000100:00100000:0.0:1787430917.149146:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856177920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430917.149152:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787430917.149250:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856177920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430917.149278:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f7c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430917.149287:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e69f7c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430917.149383:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856178048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787430917.149418:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430917.149453:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c3ff5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787430917.149547:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178048 00000100:00100000:1.0:1787430917.149552:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178048 00000100:00100000:1.0:1787430917.149590:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787430917.149598:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe0d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856178048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787430917.149612:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787430917.149629:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787430917.149632:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787430917.149714:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe0d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856178048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430917.149722:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787430917.149834:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856178048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787430917.149884:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787430917.149891:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f7c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430917.149899:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147ae00/0x1fa5b1e070e69f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e69f7c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430917.277541:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787430917.534515:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787430918.303039:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.326391:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430919.452405:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430904/real 1787430904] req@ffffa0f1c4c99500 x1874256856171136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430919.452437:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c4c99500 x1874256856171136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430919.452457:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787430904/real 1787430904] req@ffffa0f1c4c98000 x1874256856171264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430919.452469:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0f1c4c98000 x1874256856171264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787430919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787430919.452501:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe8d8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430919.452524:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787430919.452528:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856171136:0@lo:8:kworker.0 00000100:00080000:0.0:1787430919.452533:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787430919.452538:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787430919.452541:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856171264:0@lo:8:kworker.0 00000100:00080000:1.0:1787430919.452783:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430919.452788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:0.0:1787430919.452791:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856178176:0@lo:400:kworker.0 00000100:00080000:1.0:1787430919.452792:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe8d8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430919.452802:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 368 00000100:00080000:1.0:1787430919.452807:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787430919.452822:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0f2fe8d8000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787430919.452846:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c6ee1180 x1874256856178304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430919.452859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787430919.452865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787430919.452870:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787430919.452872:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787430919.452876:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 368 00000100:00080000:1.0:1787430919.452879:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787430919.452883:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0f2c562c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787430919.452898:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0f1c6ee2680 x1874256856178432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787430919.452917:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430919.452925:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856178560:0@lo:400:kworker.0 00000100:00100000:0.0:1787430919.452953:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.452988:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178176 00000100:00100000:1.0:1787430919.452990:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856178688:0@lo:400:kworker.0 00000100:00100000:0.0:1787430919.452996:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178176 00000100:00100000:1.0:1787430919.453030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.453041:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787430919.453051:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3309:x1874256856178176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430919.453057:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787430919.453064:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856178816:0@lo:400:kworker.0 00000100:00100000:0.0:1787430919.453105:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3309:x1874256856178176:12345-0@lo:400:kworker.0 Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430919.453113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.453117:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787430919.453149:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178560 00000100:00100000:1.0:1787430919.453154:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178560 00000100:00100000:1.0:1787430919.453178:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178688 00000100:00100000:1.0:1787430919.453182:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178688 00000100:00100000:0.0:1787430919.453205:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856178176:0@lo:400:kworker.0 00000100:00100000:1.0:1787430919.453210:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178816 00000100:00100000:1.0:1787430919.453214:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178816 00000100:00100000:1.0:1787430919.453233:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430919.453240:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856178560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430919.453286:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856178560:12345-0@lo:400:kworker.0 Request processed in 46us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430919.453304:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787430919.453317:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee3800 x1874256856178560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430919.453322:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787430919.453351:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856178688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430919.453351:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856178560:0@lo:400:kworker.0 00000100:00100000:1.0:1787430919.453424:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856178688:12345-0@lo:400:kworker.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430919.453431:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787430919.453437:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee0380 x1874256856178688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430919.453456:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787430919.453465:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430919.453470:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856178688:0@lo:400:kworker.0 00000100:00100000:1.0:1787430919.453515:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856178816:12345-0@lo:400:kworker.0 Request processed in 52us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430919.453521:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787430919.453545:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430919.453556:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856178304:0@lo:8:kworker.0 00010000:00080000:0.0:1787430919.453606:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee0a80 x1874256856178816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787430935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430919.453629:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856178816:0@lo:400:kworker.0 00000100:00100000:1.0:1787430919.453637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430919.453688:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856178432:0@lo:8:kworker.0 00000100:00100000:1.0:1787430919.453711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.453803:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178304 00000100:00100000:0.0:1787430919.453808:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178304 00000100:00100000:0.0:1787430919.453832:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178432 00000100:00100000:0.0:1787430919.453835:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178432 00000100:00100000:0.0:1787430919.453846:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430919.453851:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1874256856178304:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787430919.453871:0:15056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:0.0:1787430919.453899:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e69f83 00002000:00100000:0.0:1787430919.453913:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0f1c6903000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787430919.453918:0:15056:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787430919.453920:0:15056:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787430919.454249:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787430919.454273:0:15056:0:(import.c:65:import_set_state_nolock()) ffffa0f1c6904000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787430919.454319:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874256856178304:12345-0@lo:8:kworker.0 Request processed in 467us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430919.454352:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787430919.454367:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430919.454372:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1874256856178432:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787430919.454387:0:15056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:0.0:1787430919.454402:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1fa5b1e070e69f8a 00002000:00100000:0.0:1787430919.454417:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0f1c6901800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787430919.454420:0:15056:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787430919.454422:0:15056:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1787430919.454593:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee1180 x1874256856178304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430919.454604:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430919.454611:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787430919.454619:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787430919.454624:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787430919.454627:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe8d8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787430919.454645:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787430919.454652:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856178304:0@lo:8:kworker.0 00002000:00080000:0.0:1787430919.454665:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787430919.454688:0:15056:0:(import.c:65:import_set_state_nolock()) ffffa0f1c6906000 : changing import state from RECOVER to FULL 00000004:00080000:1.0:1787430919.454707:0:14398:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787430919.454728:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14398:1874256856179072:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787430919.454729:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874256856178432:12345-0@lo:8:kworker.0 Request processed in 353us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430919.454739:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430919.454765:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.454772:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856178944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430919.454786:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5721000 going to sleep for 11 seconds 00000100:00100000:0.0:1787430919.454809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430919.454813:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179072 00000100:00100000:1.0:1787430919.454818:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179072 00000100:00100000:1.0:1787430919.454853:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430919.454862:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14398:x1874256856179072:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787430919.455084:0:14397:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787430919.455420:0:14397:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383010092487ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787430919.455461:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856178944 00000100:00100000:2.0:1787430919.455466:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856178944 00000100:00100000:2.0:1787430919.455538:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430919.455546:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856178944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787430919.455570:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430919.455783:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874256856178944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430919.455790:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787430919.456059:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787430919.456600:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee2680 x1874256856178432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787430939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430919.456611:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787430919.456619:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787430919.456626:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787430919.456631:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787430919.456634:0:3306:0:(import.c:65:import_set_state_nolock()) ffffa0f2c562c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787430919.456652:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787430919.456657:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1874256856178432:0@lo:8:kworker.0 00000004:00080000:1.0:1787430919.456713:0:14400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787430919.456733:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14400:1874256856179328:0@lo:5:osp-pre-1-0.0 00010000:00080000:0.0:1787430919.456758:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee1180 x1874256856178944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787430919.456776:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.456778:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856178944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430919.456795:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787430919.456802:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5721480 going to sleep for 11 seconds 00000100:00100000:0.0:1787430919.456802:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856179200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430919.456840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430919.456880:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179200 00000100:00100000:0.0:1787430919.456885:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179200 00000100:00100000:0.0:1787430919.456927:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430919.456936:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856179200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787430919.456959:0:15061:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430919.457004:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856179200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430919.457013:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787430919.457034:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787430919.457055:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0f1c6ee2680 x1874256856179200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787430935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787430919.457079:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856179200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430919.457100:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787430919.457107:0:15056:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1787430919.457618:0:14399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787430919.457963:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383012635436ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787430919.460418:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179328 00000100:00100000:0.0:1787430919.460429:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179328 00000100:00100000:0.0:1787430919.460547:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787430919.460558:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14400:x1874256856179328:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787430919.462682:0:15058:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787430919.462693:0:15058:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787430919.462698:0:15058:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1787430919.474700:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.474716:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.474733:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.474738:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.474745:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.474763:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.474774:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.474782:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.474807:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.474817:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.474970:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.474980:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.474985:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.474995:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475019:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475026:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d98708/0x1fa5b1e070e69f91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475044:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.475046:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.475048:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.475234:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.475241:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475249:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.475252:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.475257:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475266:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475279:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475287:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475305:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.475312:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.475317:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475342:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.475346:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475354:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475365:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475371:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c815c797/0x1fa5b1e070e69f98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475398:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.475400:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.475402:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.475707:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.475713:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475722:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.475725:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.475729:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475738:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475746:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475754:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.475781:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.475786:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.475790:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475798:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.475801:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475808:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.475818:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430919.476169:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.476175:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.476184:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.476187:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.476191:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.476200:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.476209:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.476216:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.476229:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.479017:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063356c0d/0x1fa5b1e070e69f9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.479048:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.479053:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.479062:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.479072:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.479084:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.479618:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.479629:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137a9e5a/0x1fa5b1e070e69fa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.479644:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.479646:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.479648:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.479657:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.480385:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.480394:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.480407:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.480417:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.480423:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.480435:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.480445:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.480466:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.480487:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.480493:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.480498:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.480505:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.480508:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.480516:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.480528:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.480541:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6d91c08/0x1fa5b1e070e69fad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.480557:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.480559:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.480561:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.481033:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.481040:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.481049:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.481053:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.481058:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.481082:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.481091:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.481525:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.481734:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.482187:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.482194:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482203:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.482207:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482215:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482232:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482239:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007928b445/0x1fa5b1e070e69fb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482258:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.482260:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.482262:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.482374:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.482380:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482389:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.482392:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.482397:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482406:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482414:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482420:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482439:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.482443:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.482458:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482466:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.482469:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482477:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482488:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482495:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069be46d6/0x1fa5b1e070e69fbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.482509:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.482511:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.482512:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.482917:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.482923:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482937:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.482940:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.482945:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482955:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482963:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482970:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.482989:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430919.483519:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.483525:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.483534:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.483537:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.483541:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.483551:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.483569:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.483577:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.483591:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787430919.483855:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430919.483861:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483869:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a5a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.483872:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483892:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483906:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483913:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f72482b/0x1fa5b1e070e69fc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483929:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.483933:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483939:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.483943:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483950:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483959:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483967:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e896b8ac/0x1fa5b1e070e69fc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.483989:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.483991:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.483993:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.484038:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.484044:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484051:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.484054:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.484058:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484067:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484075:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484082:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484225:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430919.484630:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.484636:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484645:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.484648:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.484653:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484662:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484670:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484678:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.484687:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787430919.484735:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430919.484740:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484747:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.484750:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484759:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484771:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484778:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034468a08/0x1fa5b1e070e69fd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484792:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.484796:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484802:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c59a4c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.484811:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484818:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484829:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484836:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d32e8c/0x1fa5b1e070e69fd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.484848:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.484850:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.484852:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787430919.485214:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787430919.485312:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787430919.485810:0:16071:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787430919.485818:0:16071:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787430919.485824:0:16071:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1787430919.486617:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.486627:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.486708:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.486718:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.486724:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.486737:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.486747:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.486754:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.486773:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430919.487505:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.487513:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487523:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.487526:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.487531:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487541:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487550:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487563:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487578:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787430919.487588:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430919.487593:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487601:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.487606:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487615:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487637:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487646:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9161fd2/0x1fa5b1e070e69fde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487662:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430919.487665:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487681:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.487684:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487692:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487703:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487710:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b4f909c/0x1fa5b1e070e69fe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.487723:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.487725:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.487727:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.488819:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.488900:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.488913:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.488917:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.488923:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.488933:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.488948:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.488955:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.488969:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430919.488977:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430919.488982:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.488989:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.488992:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.489443:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.489476:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.489492:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.489499:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699d7dd3/0x1fa5b1e070e69fec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.489515:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.489523:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.489525:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.491066:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.491078:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491109:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.491114:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.491120:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491132:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491144:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491152:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491173:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430919.491641:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.491648:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491657:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.491660:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.491664:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491681:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491689:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491696:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491714:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787430919.491730:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430919.491735:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491744:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.491749:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491757:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491772:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491780:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000214f51fd/0x1fa5b1e070e69ff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491804:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430919.491808:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491814:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.491818:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491826:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491836:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491843:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4680cc8/0x1fa5b1e070e69ffa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.491856:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.491858:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.491860:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.492258:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.492264:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492273:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.492282:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.492287:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492296:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492304:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492312:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492346:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430919.492356:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430919.492359:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492366:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.492369:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492376:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492386:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492403:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac6cbecc/0x1fa5b1e070e6a001 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.492415:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.492417:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.492419:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.492421:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.493249:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.493257:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493267:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.493271:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.493275:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493285:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493293:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493300:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493324:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.493708:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.493715:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.493723:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.493727:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.493736:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430919.493745:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.493753:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.493756:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493761:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1787430919.493763:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f2db397/0x1fa5b1e070e6a008 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493765:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.493769:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493777:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.493780:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.493782:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.493784:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.493785:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493792:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.493811:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430919.494381:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.494388:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494397:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.494400:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.494404:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494414:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494429:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494436:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494463:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787430919.494473:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787430919.494477:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494484:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.494487:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494495:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494507:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494514:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ce2a8e5/0x1fa5b1e070e6a00f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494527:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787430919.494536:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494542:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.494546:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494554:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494564:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494572:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d18f51/0x1fa5b1e070e6a016 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494585:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.494587:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.494588:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.494719:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.494975:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.494981:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.494989:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.494992:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.494995:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495014:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495023:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495030:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495044:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787430919.495051:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1787430919.495199:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.495206:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495214:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.495217:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.495221:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495223:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495230:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.495233:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495235:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495242:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495243:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495251:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495254:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495260:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008800b715/0x1fa5b1e070e6a01d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495279:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.495280:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787430919.495282:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495287:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.495289:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430919.495293:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495300:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495311:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495318:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a024 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495346:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.495349:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.495351:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.495728:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.495734:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495743:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.495750:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.495755:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430919.495758:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.495763:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495765:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495771:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.495773:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495774:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.495778:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495781:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495786:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495793:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.495799:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.495802:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495811:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.495816:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495822:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.495831:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495839:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495851:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495858:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d0a74f/0x1fa5b1e070e6a02b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495870:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.495872:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.495874:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.495885:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.495892:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.495895:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495901:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.495904:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495911:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495920:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495932:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6dc7ec1/0x1fa5b1e070e6a032 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.495943:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.495945:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.495947:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.496302:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.496307:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496315:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.496318:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.496322:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496349:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496356:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496363:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496374:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.496381:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.496389:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496396:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.496399:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496407:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496419:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496426:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8895328/0x1fa5b1e070e6a039 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.496438:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.496440:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.496442:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787430919.496502:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.496508:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.496515:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.496518:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.496522:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.496531:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.496538:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.496550:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.496565:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787430919.497306:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.497312:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.497322:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.497342:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.497347:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.497357:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.497366:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.497374:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.497387:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787430919.498689:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.498700:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.498719:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.498723:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.498728:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.498739:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.498749:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.498757:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.498767:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787430919.499379:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.499386:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499394:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.499397:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787430919.499401:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499409:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499428:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499435:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499443:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787430919.499511:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787430919.499519:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499527:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.499532:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499552:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499568:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499575:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca9d3c7/0x1fa5b1e070e6a040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499594:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787430919.499597:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499605:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.499608:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499616:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499682:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499691:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035c575cb/0x1fa5b1e070e6a047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499714:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430919.499718:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499724:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.499727:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499735:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499746:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499753:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca8b3979/0x1fa5b1e070e6a04e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499763:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.499766:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499773:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd5800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.499776:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499793:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499804:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499811:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061a2b90d/0x1fa5b1e070e6a055 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430919.499822:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.499822:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.499824:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.499826:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.499827:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499835:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.499838:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.499840:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.499842:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499850:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499858:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499864:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.499893:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.499895:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.499899:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499905:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c5bd4200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.499909:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499917:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499927:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499942:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f36a7036/0x1fa5b1e070e6a05c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.499955:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.499957:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.499959:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.500313:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.500319:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500344:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.500348:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.500352:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500362:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500370:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500377:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500389:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.500395:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.500404:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500411:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.500414:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787430919.500416:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787430919.500422:0:15058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500422:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.500431:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787430919.500433:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.500434:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.500438:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500442:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a063 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.500458:0:15058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.500466:0:15058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500466:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.500468:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.500470:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787430919.500474:0:15058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430919.500490:0:15058:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.500492:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.500496:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500502:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a1400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.500506:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500525:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500535:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500543:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd9894fa/0x1fa5b1e070e6a06a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.500555:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.500557:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.500559:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787430919.500648:0:15058:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1787430919.500737:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14398:x1874256856179072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 45873us (45968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430919.500746:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787430919.500794:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14398:1874256856179072:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787430919.500816:0:14398:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787430919.500856:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14398:1874256856179456:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787430919.500892:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430919.500927:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179456 00000100:00100000:1.0:1787430919.500933:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179456 00000100:00100000:1.0:1787430919.500970:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430919.500978:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14398:x1874256856179456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787430919.501013:0:15056:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:0.0:1787430919.502252:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.502261:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.502275:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.502278:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.502283:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.502294:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.502303:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.502316:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.502359:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.503732:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.503741:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.503751:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.503756:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.503765:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.503785:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.503792:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.503822:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.503824:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.503826:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.504892:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.504901:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.504914:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.504918:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.504923:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.504935:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.504945:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.504954:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.504971:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.504980:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.504984:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.504998:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.505001:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505008:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505020:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505026:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505040:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.505042:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.505044:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.505463:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.505471:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505480:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.505483:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.505487:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505496:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505510:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505517:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505532:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.505541:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.505545:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505552:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.505555:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505562:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505573:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505580:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a07f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.505592:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.505598:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.505600:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430919.507822:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28c00 going to sleep for 11 seconds 00002000:00010000:0.0:1787430919.508247:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.508256:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508271:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.508276:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.508282:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508294:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508305:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508312:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508345:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.508358:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.508363:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508371:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.508374:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508394:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508410:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508417:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008610dbb4/0x1fa5b1e070e6a086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508431:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.508434:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.508435:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.508901:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.508908:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508916:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.508919:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.508924:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508933:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508940:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508953:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508968:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.508976:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.508981:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508988:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.508991:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.508998:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509010:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509017:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f15d4b/0x1fa5b1e070e6a08d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509030:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.509032:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.509034:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.509417:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.509429:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509436:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.509439:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.509443:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509464:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509471:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509478:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509493:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.509501:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.509505:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509512:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.509516:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509524:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509539:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509545:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d456efc/0x1fa5b1e070e6a094 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.509555:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.509557:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.509558:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430919.509625:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14398:x1874256856179456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8643us (8729us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787430919.509640:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430919.509695:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14398:1874256856179456:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787430919.509708:0:14398:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00010000:0.0:1787430919.510839:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.510848:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.510859:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.510862:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.510867:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.510877:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.510885:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.510893:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.510929:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787430919.511292:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.511298:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511306:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.511309:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.511313:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511322:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511351:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511358:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511371:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787430919.511381:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787430919.511386:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511394:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.511403:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511411:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511425:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511432:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9ddd9c/0x1fa5b1e070e6a09b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511462:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.511465:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511472:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.511474:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511482:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.511798:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.511834:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511842:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba238d2e/0x1fa5b1e070e6a0a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.511861:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.511863:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.511865:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.512260:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.512267:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512276:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.512279:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.512284:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512294:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512301:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512309:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512320:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.512378:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.512384:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.512391:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.512395:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.512403:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.512415:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.512422:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a8b7f9/0x1fa5b1e070e6a0a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.512435:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.512437:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.512438:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.512934:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.512940:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512958:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.512961:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.512965:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512975:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512984:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.512991:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513005:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787430919.513014:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787430919.513018:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513024:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430919.513028:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513035:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513056:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513063:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c8efe5/0x1fa5b1e070e6a0b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513076:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.513078:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.513080:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.513790:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.513798:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513807:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.513811:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.513815:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513824:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513834:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.513841:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.514077:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787430919.514634:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.514641:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.514651:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.514654:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.514658:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.514668:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.514676:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.514684:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.514948:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430919.514955:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.514970:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.514975:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.514984:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.514998:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515005:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c819d29/0x1fa5b1e070e6a0b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515059:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.515064:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515070:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.515075:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515081:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515091:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515104:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.515106:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.515108:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.515140:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787430919.515146:0:16071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000602d924c/0x1fa5b1e070e6a0be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430919.515618:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.515625:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.515639:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.515642:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.515647:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.515656:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.515664:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.515671:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.515684:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787430919.515981:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.515987:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.515995:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.515999:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.516008:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.516019:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.516028:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6dd568/0x1fa5b1e070e6a0c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.516041:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.516043:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.516044:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.516435:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.517178:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.517188:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517200:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.517204:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.517209:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517219:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517240:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517247:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517264:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787430919.517675:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.517682:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517691:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.517694:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.517698:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517708:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517716:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517722:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.517811:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787430919.518191:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.518197:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.518206:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.518209:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.518213:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.518221:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.518228:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.518236:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518414:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787430919.518423:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518432:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.518436:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518444:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518474:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518481:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671aed9c/0x1fa5b1e070e6a0cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518651:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430919.518657:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518664:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.518668:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518685:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518695:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518715:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e68af07/0x1fa5b1e070e6a0d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518727:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430919.518730:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518736:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.518739:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518745:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518754:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.518761:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430919.518763:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430919.518770:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787430919.519194:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787430919.519200:0:16071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017a0762/0x1fa5b1e070e6a0da lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430919.519687:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.519694:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.519709:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.519713:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.519718:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.519728:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.519737:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.519745:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.519754:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787430919.520125:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.520131:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520139:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.520142:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.520147:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520155:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520172:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520179:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520187:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787430919.520584:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.520590:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520598:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.520601:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.520605:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520613:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520620:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520626:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520642:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787430919.520967:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.520972:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520979:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.520982:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.520986:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.520993:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521000:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521006:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521013:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787430919.521386:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.521392:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521400:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.521407:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.521411:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521421:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521429:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521435:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521443:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787430919.521798:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.521803:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521811:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.521813:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.521818:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521825:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521832:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521843:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.521851:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787430919.522397:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787430919.522405:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522414:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.522418:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522427:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522443:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522462:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e938faa7/0x1fa5b1e070e6a0e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522480:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787430919.522484:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522490:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c3000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.522494:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522501:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522518:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522523:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be6c4934/0x1fa5b1e070e6a0e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522534:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787430919.522537:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522544:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c68c2c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.522546:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522553:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522560:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522566:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fcaff32/0x1fa5b1e070e6a0ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522577:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787430919.522580:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522590:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.522593:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522602:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522612:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522618:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f94bf351/0x1fa5b1e070e6a0f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522634:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787430919.522637:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522643:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.522646:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522654:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522662:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522674:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a0fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522684:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787430919.522687:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522692:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430919.522695:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522702:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522709:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522715:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a64fa612/0x1fa5b1e070e6a104 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430919.522724:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430919.522725:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430919.522727:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.523735:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787430919.524500:0:16071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787430919.524509:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.524523:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787430919.524528:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430919.524534:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.524546:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.524556:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.524564:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430919.524583:0:16071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787430919.524916:0:16071:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787430919.525008:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14400:x1874256856179328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64449us (68230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430919.525025:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787430919.526080:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14400:1874256856179328:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787430919.526100:0:14400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787430919.526142:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14400:1874256856179584:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787430919.526183:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430919.526215:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2fdf28c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787430919.526237:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179584 00000100:00100000:1.0:1787430919.526242:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179584 00000100:00100000:1.0:1787430919.526288:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430919.526297:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1874256856179584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787430919.526347:0:15057:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1787430919.528468:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430919.528489:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.528502:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430919.528507:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.528517:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.528538:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.528546:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a10b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430919.528564:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.528566:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430919.528568:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787430919.532255:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787430919.543239:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14400:x1874256856179584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16934us (17045us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787430919.543252:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430919.545622:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c6ee0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14400:1874256856179584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787430919.545653:0:14400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:02000400:2.0:1787430920.117036:0:16129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787430920.350801:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787430920.483553:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787430920.483574:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787430920.503208:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787430920.503226:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1787430921.372631:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430922.035824:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.036013:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513472 00000100:00100000:2.0:1787430922.036046:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513472 00000100:00100000:2.0:1787430922.036108:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:2.0:1787430922.036120:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2370:x1874256841513472:12345-192.168.204.60@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787430922.036160:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 10bf22de-8fca-4146-bbff-81081a3cfdf0@192.168.204.60@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1787430922.036209:0:14368:0:(genops.c:1385:class_connect()) connect: client 10bf22de-8fca-4146-bbff-81081a3cfdf0, cookie 0x1fa5b1e070e6a112 00000100:00080000:3.0:1787430922.037034:0:14368:0:(import.c:65:import_set_state_nolock()) ffffa0f2c8d68000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787430922.037189:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+5:2370:x1874256841513472:12345-192.168.204.60@tcp:250:mount.lustre.0 Request processed in 1068us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430922.037201:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:2.0:1787430922.042012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.043130:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513600 00000100:00100000:1.0:1787430922.043148:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513600 00000100:00100000:1.0:1787430922.043426:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:1.0:1787430922.043440:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+5:13733:x1874256841513600:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787430922.043465:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430922.043490:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f1c71a1600/0x1fa5b1e070e6a119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14927 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.043545:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f1c71a1600/0x1fa5b1e070e6a119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14927 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.043558:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f1c71a1600/0x1fa5b1e070e6a119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14927 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.043570:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a1600, rc 0) 00000100:00100000:1.0:1787430922.043677:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+6:13733:x1874256841513600:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 239us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430922.043684:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:0.0:1787430922.048753:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430922.049370:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513728 00000100:00100000:3.0:1787430922.049383:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513728 00000100:00100000:3.0:1787430922.049470:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:3.0:1787430922.049483:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+6:13733:x1874256841513728:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787430922.050751:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+6:13733:x1874256841513728:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 1261us (2005us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787430922.050767:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:3.0:1787430922.053951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.054760:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513856 00000100:00100000:1.0:1787430922.054775:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513856 00000100:00100000:1.0:1787430922.057070:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:1.0:1787430922.057101:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+6:13733:x1874256841513856:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787430922.057125:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430922.057151:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f1c71a1000/0x1fa5b1e070e6a120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1492e expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.057219:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f1c71a1000/0x1fa5b1e070e6a120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1492e expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.057612:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f1c71a1000/0x1fa5b1e070e6a120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1492e expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.057624:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a1000, rc 0) 00000100:00100000:1.0:1787430922.058106:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+7:13733:x1874256841513856:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 1015us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430922.058115:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:2.0:1787430922.061222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430922.061498:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841513984 00000100:00100000:3.0:1787430922.061517:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841513984 00000100:00100000:3.0:1787430922.061972:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:3.0:1787430922.061988:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+7:13733:x1874256841513984:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787430922.062533:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13733:x1874256841513984:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 547us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430922.062544:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:0.0:1787430922.067889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.068066:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514112 00000100:00100000:1.0:1787430922.068078:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514112 00000100:00100000:1.0:1787430922.068145:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:1.0:1787430922.068156:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13733:x1874256841514112:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787430922.068936:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13733:x1874256841514112:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 774us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430922.068951:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:0.0:1787430922.072219:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430922.076699:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514240 00000100:00100000:3.0:1787430922.076781:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514240 00000100:00100000:3.0:1787430922.076888:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787430922.076899:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13751:x1874256841514240:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787430922.077366:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13751:x1874256841514240:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 428us (5122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430922.077377:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:2.0:1787430922.105501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430922.105862:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514368 00000100:00100000:0.0:1787430922.105879:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514368 00000100:00100000:0.0:1787430922.107215:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:0.0:1787430922.107241:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13751:x1874256841514368:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430922.107676:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13751:x1874256841514368:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 444us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430922.107686:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:0.0:1787430922.113523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.114009:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514496 00000100:00100000:1.0:1787430922.114022:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514496 00000100:00100000:1.0:1787430922.114098:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:1.0:1787430922.114111:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+8:13733:x1874256841514496:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787430922.114147:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430922.114173:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f1c71a0a00/0x1fa5b1e070e6a127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14958 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.114210:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f1c71a0a00/0x1fa5b1e070e6a127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14958 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.114243:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f1c71a0a00/0x1fa5b1e070e6a127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14958 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.114254:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a0a00, rc 0) 00000100:00100000:1.0:1787430922.114496:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+9:13733:x1874256841514496:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 385us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430922.114504:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:1.0:1787430922.124565:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430922.127188:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514624 00000100:00100000:0.0:1787430922.127212:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514624 00000100:00100000:0.0:1787430922.127304:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:0.0:1787430922.127525:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+9:13733:x1874256841514624:12345-192.168.204.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787430922.127563:0:14369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787430922.127610:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787430922.127615:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787430922.127619:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787430922.127621:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787430922.136572:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe10d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+9:13733:x1874256841514624:12345-192.168.204.60@tcp:256:mount.lustre.0 Request processed in 9024us (11996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430922.136612:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:1.0:1787430922.142849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.144004:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514752 00000100:00100000:2.0:1787430922.144019:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514752 00000100:00100000:2.0:1787430922.144107:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:2.0:1787430922.144120:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+9:13733:x1874256841514752:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787430922.144144:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430922.144169:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc1495f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430922.144206:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430922.144219:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430922.144230:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74800, rc 0) 00000100:00100000:2.0:1787430922.144505:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13733:x1874256841514752:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 190us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.144515:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:1.0:1787430922.147630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430922.147873:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841514880 00000100:00100000:0.0:1787430922.147886:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841514880 00000100:00100000:0.0:1787430922.147959:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:0.0:1787430922.147972:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13733:x1874256841514880:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787430922.148570:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5617050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13733:x1874256841514880:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 598us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430922.148580:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:0.0:1787430922.152029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.152136:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515008 00000100:00100000:2.0:1787430922.152163:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515008 00000100:00100000:2.0:1787430922.152267:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787430922.152279:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13733:x1874256841515008:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787430922.152764:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5615c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13733:x1874256841515008:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 485us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.152773:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:1.0:1787430922.160675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.161292:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515136 00000100:00100000:2.0:1787430922.161305:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515136 00000100:00100000:2.0:1787430922.161407:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:2.0:1787430922.161419:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13754:x1874256841515136:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430922.161790:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13754:x1874256841515136:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 371us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.161798:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:1.0:1787430922.166637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.167028:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515264 00000100:00100000:2.0:1787430922.167043:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515264 00000100:00100000:2.0:1787430922.167471:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:2.0:1787430922.167485:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13754:x1874256841515264:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430922.167848:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13754:x1874256841515264:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 365us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.167858:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:1.0:1787430922.177210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.177434:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515392 00000100:00100000:2.0:1787430922.177448:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515392 00000100:00100000:2.0:1787430922.177513:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:2.0:1787430922.177524:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2370:x1874256841515392:12345-192.168.204.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787430922.177566:0:14375:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from eeb368b9-740b-4f2b-bbb3-3252d41bdc70@192.168.204.60@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1787430922.177674:0:14375:0:(genops.c:1385:class_connect()) connect: client eeb368b9-740b-4f2b-bbb3-3252d41bdc70, cookie 0x1fa5b1e070e6a135 00000004:00100000:2.0:1787430922.177718:0:14375:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787430922.177726:0:14375:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787430922.232166:0:14375:0:(import.c:65:import_set_state_nolock()) ffffa0f2fe474000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430922.232466:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2370:x1874256841515392:12345-192.168.204.60@tcp:38:mount.lustre.0 Request processed in 54939us (55268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.232481:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:1.0:1787430922.237090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.237165:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.237445:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515520 00000100:00100000:3.0:1787430922.237446:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515648 00000100:00100000:3.0:1787430922.237459:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515648 00000100:00100000:2.0:1787430922.237459:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515520 00000100:00080000:0.0:1787430922.237527:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787430922.237550:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:3.0:1787430922.237563:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:13733:x1874256841515648:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787430922.237618:0:14376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787430922.237777:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:13733:x1874256841515648:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 217us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430922.237785:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:3.0:1787430922.237805:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:3.0:1787430922.237811:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:0:x1874256841515520:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787430922.237823:0:14376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787430922.237845:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:0:x1874256841515520:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 34us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430922.237852:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:1.0:1787430922.245901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430922.246181:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515776 00000100:00100000:2.0:1787430922.246196:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515776 00000100:00100000:2.0:1787430922.246446:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430922.246457:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13733:x1874256841515776:12345-192.168.204.60@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787430922.246568:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13733:x1874256841515776:12345-192.168.204.60@tcp:40:mount.lustre.0 Request processed in 113us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.246576:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:0.0:1787430922.249950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430922.249991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.250101:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516160 00000100:00100000:1.0:1787430922.250121:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516160 00000100:00100000:1.0:1787430922.250196:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787430922.250210:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13733:x1874256841516160:12345-192.168.204.60@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787430922.250387:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841515904 00000100:00100000:2.0:1787430922.250408:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841515904 00000100:00100000:2.0:1787430922.250454:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787430922.250463:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2370:x1874256841515904:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787430922.250495:0:15058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from eeb368b9-740b-4f2b-bbb3-3252d41bdc70@192.168.204.60@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1787430922.250558:0:15058:0:(genops.c:1385:class_connect()) connect: client eeb368b9-740b-4f2b-bbb3-3252d41bdc70, cookie 0x1fa5b1e070e6a13c 00002000:00100000:2.0:1787430922.250572:0:15058:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eeb368b9-740b-4f2b-bbb3-3252d41bdc70/ffffa0f2c7e46000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787430922.250607:0:15058:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787430922.250736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.250983:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516032 00000100:00100000:1.0:1787430922.250992:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516032 00002000:00080000:2.0:1787430922.250997:0:15058:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787430922.251031:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:1.0:1787430922.251039:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1874256841516032:12345-192.168.204.60@tcp:8:mount.lustre.0 00000100:00080000:2.0:1787430922.251044:0:15058:0:(import.c:65:import_set_state_nolock()) ffffa0f2c7e41000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787430922.251069:0:15056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from eeb368b9-740b-4f2b-bbb3-3252d41bdc70@192.168.204.60@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:1.0:1787430922.251123:0:15056:0:(genops.c:1385:class_connect()) connect: client eeb368b9-740b-4f2b-bbb3-3252d41bdc70, cookie 0x1fa5b1e070e6a143 00000100:00100000:2.0:1787430922.251133:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2370:x1874256841515904:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 667us (1138us total) trans 0 rc 0/0 00002000:00100000:1.0:1787430922.251135:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eeb368b9-740b-4f2b-bbb3-3252d41bdc70/ffffa0f1c6154800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1787430922.251156:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00002000:00100000:1.0:1787430922.251174:0:15056:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787430922.251618:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787430922.251650:0:15056:0:(import.c:65:import_set_state_nolock()) ffffa0f1c6154000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430922.251709:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2370:x1874256841516032:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 668us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430922.251718:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000004:00080000:3.0:1787430922.252123:0:14378:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1819us 00000004:00200000:2.0:1787430922.272485:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787430922.272721:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13733:x1874256841516160:12345-192.168.204.60@tcp:33:mount.lustre.0 Request processed in 22508us (22774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430922.272736:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00010000:00010000:2.0:1787430922.396686:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430922.464828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430922.464916:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516288 00000100:00100000:1.0:1787430922.464928:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516288 00000100:00100000:1.0:1787430922.464993:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:1.0:1787430922.465004:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13775:x1874256841516288:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787430922.465027:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430922.465054:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0800/0x1fa5b1e070e6a14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14989 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.465135:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.465148:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.465162:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430922.465568:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787430922.465572:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430922.465675:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.465713:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0800/0x1fa5b1e070e6a14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14989 expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.465731:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14989 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430922.465740:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:1.0:1787430922.465743:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787430922.465746:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a1e00, rc 0) 00000100:00100000:1.0:1787430922.465812:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:13775:x1874256841516288:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 810us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430922.465820:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00010000:00010000:0.0:1787430923.420818:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430924.444588:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430924.454667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430924.457269:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516416 00000100:00100000:2.0:1787430924.457283:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516416 00000100:00080000:0.0:1787430924.457378:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430924.457422:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430924.457434:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:13827:x1874256841516416:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787430924.457479:0:14377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787430924.457591:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:13827:x1874256841516416:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 158us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.457599:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430924.463869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430924.466826:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516544 00000100:00100000:0.0:1787430924.466839:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516544 00000100:00100000:0.0:1787430924.466934:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787430924.466944:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13827:x1874256841516544:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787430924.466981:0:15061:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787430924.467085:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13827:x1874256841516544:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 142us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430924.467093:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00080000:1.0:1787430924.467219:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787430924.472136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.472261:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516672 00000100:00100000:3.0:1787430924.472272:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516672 00000100:00100000:3.0:1787430924.472445:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:3.0:1787430924.472457:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13827:x1874256841516672:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787430924.472495:0:15061:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430924.472591:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:13827:x1874256841516672:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 136us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.472598:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00080000:1.0:1787430924.475678:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430924.508810:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856179968:0@lo:400:kworker.0 00000100:00100000:0.0:1787430924.508854:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856180096:0@lo:400:kworker.0 00000100:00100000:1.0:1787430924.508886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430924.508950:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856180480:0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.508970:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856179712:0@lo:400:kworker.0 00000100:00100000:1.0:1787430924.508981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430924.509019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430924.509020:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856180224:0@lo:400:kworker.0 00000100:00100000:1.0:1787430924.509054:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430924.509066:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2fdee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856179840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430924.509094:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179968 00000100:00100000:1.0:1787430924.509103:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179968 00000100:00100000:3.0:1787430924.509108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430924.509128:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856180352:0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.509151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430924.509178:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179840 00000100:00100000:3.0:1787430924.509182:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179840 00000100:00100000:3.0:1787430924.509247:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430924.509253:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430924.509259:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856179840:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430924.509265:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856179968:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787430924.509287:0:15061:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787430924.509372:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874256856179968:12345-0@lo:400:kworker.0 Request processed in 109us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.509379:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874256856179840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.509385:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787430924.509391:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787430924.509420:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787430924.509441:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787430924.509461:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2fdee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856179840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430924.509497:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180480 00000100:00100000:3.0:1787430924.509500:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180480 00000100:00100000:3.0:1787430924.509524:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180224 00000100:00100000:3.0:1787430924.509527:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180224 00000100:00100000:3.0:1787430924.509551:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180352 00000100:00100000:3.0:1787430924.509554:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180352 00000100:00100000:3.0:1787430924.509566:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430924.509761:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856180480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.509799:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856180480:12345-0@lo:400:kworker.0 Request processed in 227us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.509806:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787430924.509818:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787430924.509831:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856180224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430924.509843:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856179968:0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.509871:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874256856180224:12345-0@lo:400:kworker.0 Request processed in 40us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.509872:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856180480:0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.509892:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787430924.509907:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874256856180224:0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.509911:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787430924.509922:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856180352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430924.509942:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856179712 00000100:00100000:1.0:1787430924.509947:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856179712 00000100:00100000:3.0:1787430924.509960:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856180352:12345-0@lo:400:kworker.0 Request processed in 40us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.509967:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430924.509983:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787430924.509989:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430924.509994:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3307:x1874256856179712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.510013:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856180352:0@lo:400:kworker.0 00000100:00100000:1.0:1787430924.510032:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5617450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3307:x1874256856179712:12345-0@lo:400:kworker.0 Request processed in 40us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.510040:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787430924.510052:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856179712:0@lo:400:kworker.0 00000100:00100000:0.0:1787430924.510492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430924.510876:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180096 00000100:00100000:2.0:1787430924.510887:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180096 00000100:00100000:2.0:1787430924.510927:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787430924.510935:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856180096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430924.510974:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856180096:12345-0@lo:400:kworker.0 Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.510980:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787430924.510998:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787430924.512957:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856180608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787430924.513034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430924.513095:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787430924.513115:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856180096:0@lo:400:kworker.0 00000100:00100000:3.0:1787430924.513151:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180608 00000100:00100000:3.0:1787430924.513160:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180608 00000100:00100000:3.0:1787430924.513278:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787430924.513289:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856180608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787430924.513312:0:15061:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430924.513446:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856180608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.513454:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430924.513558:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856180608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430924.639748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430924.639875:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516800 00000100:00100000:2.0:1787430924.639896:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516800 00000100:00100000:2.0:1787430924.639969:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:2.0:1787430924.639980:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+10:13859:x1874256841516800:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787430924.639999:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430924.640020:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e6a158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14990 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430924.640053:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e6a158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14990 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430924.640064:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74c00/0x1fa5b1e070e6a158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14990 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430924.640074:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74c00, rc 0) 00000100:00100000:2.0:1787430924.640148:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13859:x1874256841516800:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 170us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.640155:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:0.0:1787430924.649066:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.649195:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841516928 00000100:00100000:1.0:1787430924.649206:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841516928 00000100:00100000:1.0:1787430924.649314:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:1.0:1787430924.649377:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13859:x1874256841516928:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430924.649801:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5616850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13859:x1874256841516928:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 475us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.649810:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:0.0:1787430924.666792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430924.666905:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517056 00000100:00100000:2.0:1787430924.666915:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517056 00000100:00100000:2.0:1787430924.666974:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:2.0:1787430924.666984:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13859:x1874256841517056:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787430924.667251:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5615050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13859:x1874256841517056:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 268us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.667260:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:3.0:1787430924.673851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.674048:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517184 00000100:00100000:1.0:1787430924.674063:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517184 00000100:00100000:1.0:1787430924.674191:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:1.0:1787430924.674205:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13866:x1874256841517184:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430924.674567:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5614050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13866:x1874256841517184:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 365us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.674589:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:3.0:1787430924.689256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430924.689427:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517312 00000100:00100000:0.0:1787430924.689437:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517312 00000100:00100000:0.0:1787430924.689500:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:0.0:1787430924.689510:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13866:x1874256841517312:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787430924.689799:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5617850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13866:x1874256841517312:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 290us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430924.689808:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:0.0:1787430924.692655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.692744:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517440 00000100:00100000:1.0:1787430924.692755:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517440 00000100:00100000:1.0:1787430924.692812:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 94 00000100:00100000:1.0:1787430924.692823:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c5614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13859:x1874256841517440:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787430924.692843:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430924.692861:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f1c71a0800/0x1fa5b1e070e6a15f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc149ba expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430924.693611:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f1c71a0800/0x1fa5b1e070e6a15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149ba expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430924.693627:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f1c71a0800/0x1fa5b1e070e6a15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149ba expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430924.693638:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a0800, rc 0) 00000100:00100000:1.0:1787430924.693702:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c5614850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13859:x1874256841517440:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 881us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.693710:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 94 00000100:00100000:3.0:1787430924.698512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430924.698718:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517568 00000100:00100000:2.0:1787430924.698790:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517568 00000100:00100000:2.0:1787430924.698908:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:2.0:1787430924.698934:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13859:x1874256841517568:12345-192.168.204.60@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787430924.698971:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787430924.698990:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787430924.698994:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787430924.698998:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787430924.699000:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787430924.700525:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13859:x1874256841517568:12345-192.168.204.60@tcp:256:mount.lustre.0 Request processed in 1587us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.700545:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:1.0:1787430924.706198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.706319:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517696 00000100:00100000:3.0:1787430924.706387:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517696 00000100:00100000:3.0:1787430924.706434:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 96 00000100:00100000:3.0:1787430924.706444:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13859:x1874256841517696:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787430924.706461:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430924.706478:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc149c1 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.706660:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.706672:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.706681:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b800, rc 0) 00000100:00100000:3.0:1787430924.706743:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13859:x1874256841517696:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 299us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.706750:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 96 00000100:00100000:2.0:1787430924.708702:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.708787:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517824 00000100:00100000:1.0:1787430924.708795:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517824 00000100:00100000:1.0:1787430924.708851:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:1.0:1787430924.708860:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13859:x1874256841517824:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787430924.709148:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13859:x1874256841517824:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 287us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.709156:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:1.0:1787430924.716380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430924.716542:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841517952 00000100:00100000:0.0:1787430924.716554:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841517952 00000100:00100000:0.0:1787430924.716613:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 98 00000100:00100000:0.0:1787430924.716625:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13859:x1874256841517952:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787430924.716893:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13859:x1874256841517952:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 269us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430924.716902:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 98 00000100:00100000:0.0:1787430924.722984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.723838:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518080 00000100:00100000:3.0:1787430924.723848:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518080 00000100:00100000:2.0:1787430924.724064:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:2.0:1787430924.724075:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13870:x1874256841518080:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787430924.724363:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13870:x1874256841518080:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 289us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.724372:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:2.0:1787430924.727118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.727296:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518208 00000100:00100000:1.0:1787430924.727306:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518208 00000100:00100000:1.0:1787430924.727399:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:1.0:1787430924.727411:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13870:x1874256841518208:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787430924.727808:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13870:x1874256841518208:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 398us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.727818:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:1.0:1787430924.735300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.735581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.735842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.735881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430924.735909:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518976 00000100:00100000:1.0:1787430924.735920:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518976 00000100:00100000:1.0:1787430924.735965:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518848 00000100:00100000:1.0:1787430924.735968:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518848 00000100:00100000:1.0:1787430924.735986:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:1.0:1787430924.735995:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841518976:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430924.736070:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841518976:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.736079:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:1.0:1787430924.736096:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:1.0:1787430924.736103:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841518848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430924.736144:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841518848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.736151:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:3.0:1787430924.736975:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518336 00000100:00100000:3.0:1787430924.736982:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518336 00000100:00100000:3.0:1787430924.737057:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518720 00000100:00100000:3.0:1787430924.737060:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518720 00000100:00100000:2.0:1787430924.737107:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787430924.737119:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2373:x1874256841518720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430924.737178:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2373:x1874256841518720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 62us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.737185:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787430924.737201:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:2.0:1787430924.737205:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2370:x1874256841518336:12345-192.168.204.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787430924.737240:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f1b61aeb-d968-445f-98a2-5f2b7302c59a@192.168.204.60@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:2.0:1787430924.737288:0:14377:0:(genops.c:1385:class_connect()) connect: client f1b61aeb-d968-445f-98a2-5f2b7302c59a, cookie 0x1fa5b1e070e6a16d 00000004:00100000:2.0:1787430924.737320:0:14377:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787430924.737466:0:14377:0:(import.c:65:import_set_state_nolock()) ffffa0f2c7e45000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787430924.737499:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2370:x1874256841518336:12345-192.168.204.60@tcp:38:mount.lustre.0 Request processed in 292us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.737506:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787430924.740410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.740483:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518464 00000100:00100000:3.0:1787430924.740491:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518464 00000100:00100000:3.0:1787430924.740558:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:3.0:1787430924.740567:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:0:x1874256841518464:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787430924.740597:0:14375:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787430924.740670:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:0:x1874256841518464:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 104us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.740692:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00080000:2.0:1787430924.741249:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787430924.742954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430924.743052:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841518592 00000100:00100000:2.0:1787430924.743061:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841518592 00000100:00100000:2.0:1787430924.743113:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:2.0:1787430924.743123:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13859:x1874256841518592:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787430924.743153:0:14377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787430924.743233:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13859:x1874256841518592:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.743241:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:1.0:1787430924.753029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430924.753130:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519104 00000100:00100000:0.0:1787430924.753140:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519104 00000100:00100000:0.0:1787430924.753204:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:0.0:1787430924.753226:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13859:x1874256841519104:12345-192.168.204.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787430924.753322:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13859:x1874256841519104:12345-192.168.204.60@tcp:40:mount.lustre.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430924.753376:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:1.0:1787430924.758807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.758967:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519488 00000100:00100000:3.0:1787430924.758977:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519488 00000100:00100000:1.0:1787430924.758990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.759038:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:3.0:1787430924.759051:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13859:x1874256841519488:12345-192.168.204.60@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787430924.759124:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519232 00000100:00100000:2.0:1787430924.759129:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519232 00000100:00100000:2.0:1787430924.759158:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430924.759166:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2370:x1874256841519232:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787430924.759191:0:15058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f1b61aeb-d968-445f-98a2-5f2b7302c59a@192.168.204.60@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:2.0:1787430924.759224:0:15058:0:(genops.c:1385:class_connect()) connect: client f1b61aeb-d968-445f-98a2-5f2b7302c59a, cookie 0x1fa5b1e070e6a174 00002000:00100000:2.0:1787430924.759236:0:15058:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1b61aeb-d968-445f-98a2-5f2b7302c59a/ffffa0f2c7e47800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1787430924.759243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00002000:00100000:2.0:1787430924.759247:0:15058:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787430924.759272:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519360 00000100:00100000:1.0:1787430924.759276:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519360 00000100:00100000:1.0:1787430924.759300:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:1.0:1787430924.759306:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1874256841519360:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787430924.759321:0:15056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f1b61aeb-d968-445f-98a2-5f2b7302c59a@192.168.204.60@tcp t0 exp 0000000000000000 cur 388 last 0 00002000:00080000:2.0:1787430924.759412:0:15058:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787430924.759444:0:15058:0:(import.c:65:import_set_state_nolock()) ffffa0f2c7e40800 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1787430924.759452:0:15056:0:(genops.c:1385:class_connect()) connect: client f1b61aeb-d968-445f-98a2-5f2b7302c59a, cookie 0x1fa5b1e070e6a17b 00002000:00100000:1.0:1787430924.759459:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f1b61aeb-d968-445f-98a2-5f2b7302c59a/ffffa0f1c6151000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787430924.759465:0:15056:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:0.0:1787430924.759466:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787430924.759528:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2370:x1874256841519232:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 360us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430924.759536:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00002000:00080000:1.0:1787430924.759590:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787430924.759607:0:15056:0:(import.c:65:import_set_state_nolock()) ffffa0f1c6151800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787430924.759634:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2370:x1874256841519360:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 327us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430924.759642:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:0.0:1787430924.759813:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13859:x1874256841519488:12345-192.168.204.60@tcp:33:mount.lustre.0 Request processed in 763us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430924.759825:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:1.0:1787430924.923876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430924.923971:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519616 00000100:00100000:3.0:1787430924.923982:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519616 00000100:00100000:3.0:1787430924.924045:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:3.0:1787430924.924056:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:13891:x1874256841519616:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787430924.924077:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430924.924102:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6a182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc149eb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.924171:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.924186:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.924200:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430924.924462:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787430924.924465:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430924.924545:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.924574:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147b600/0x1fa5b1e070e6a182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.924601:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430924.924609:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:3.0:1787430924.924612:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430924.924616:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147a800, rc 0) 00000100:00100000:3.0:1787430924.924673:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+7:13891:x1874256841519616:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 619us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430924.924681:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00010000:00010000:0.0:1787430925.468684:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787430925.572043:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1b61aeb-d968-445f-98a2-5f2b7302c59a 00000001:00100000:2.0:1787430925.572062:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eeb368b9-740b-4f2b-bbb3-3252d41bdc70 00000001:00100000:3.0:1787430925.580212:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f1b61aeb-d968-445f-98a2-5f2b7302c59a 00000001:00100000:3.0:1787430925.580226:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eeb368b9-740b-4f2b-bbb3-3252d41bdc70 00010000:00010000:2.0:1787430926.493522:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787430927.404563:0:16332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787430927.516572:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787430927.603550:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f1b61aeb-d968-445f-98a2-5f2b7302c59a 00000001:00100000:1.0:1787430927.603567:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eeb368b9-740b-4f2b-bbb3-3252d41bdc70 00000040:00080000:1.0:1787430927.773128:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787430928.542063:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430929.565660:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430929.629777:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec3bb70-eba8-428d-9804-5196e7d74be3:3310:1874256856180736:0@lo:400:kworker.0 00000100:00100000:0.0:1787430929.629777:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856181120:0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.629883:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856180992:0@lo:400:kworker.0 00000100:00100000:3.0:1787430929.629890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430929.629950:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856181248:0@lo:400:kworker.0 00000100:00100000:2.0:1787430929.630005:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180736 00000100:00100000:2.0:1787430929.630242:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180736 00000100:00100000:2.0:1787430929.630322:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787430929.630370:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3310:x1874256856180736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.632404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430929.632538:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856181504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430929.632658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430929.632683:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787430929.632690:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856180864:0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.632712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430929.632732:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856181376:0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.632757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430929.632845:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180992 00000100:00100000:1.0:1787430929.632854:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180992 00000100:00100000:1.0:1787430929.632918:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856180864 00000100:00100000:1.0:1787430929.632922:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856180864 00000100:00100000:1.0:1787430929.632950:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430929.632962:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856180992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.633020:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856180992:12345-0@lo:400:kworker.0 Request processed in 61us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430929.633028:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787430929.633051:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787430929.633057:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856180864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.633081:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856180864:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430929.633087:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787430929.633406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430929.633716:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856181632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430929.633751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430929.634459:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430929.634533:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3310:x1874256856180736:12345-0@lo:400:kworker.0 Request processed in 4165us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430929.634753:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787430929.634817:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856181504 00000100:00100000:2.0:1787430929.634824:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856181504 00000100:00100000:2.0:1787430929.634852:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856181632 00000100:00100000:2.0:1787430929.634855:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856181632 00000100:00100000:2.0:1787430929.634869:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430929.634877:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856181504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430929.634919:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430929.634965:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874256856181504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430929.634972:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430929.634988:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430929.634992:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856181376 00000100:00100000:2.0:1787430929.634998:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856181632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430929.635000:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856181376 00002000:00000024:2.0:1787430929.635034:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787430929.635035:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856181120 00000100:00100000:3.0:1787430929.635041:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856181120 00000100:00100000:3.0:1787430929.635062:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856181248 00000100:00100000:3.0:1787430929.635065:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856181248 00000100:00100000:2.0:1787430929.635087:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856181632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430929.635090:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787430929.635101:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787430929.635105:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856181376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787430929.635128:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787430929.635139:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1787430929.635158:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430929.635163:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430929.635166:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787430929.635785:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874256856181376:12345-0@lo:400:kworker.0 Request processed in 682us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430929.635813:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787430929.635834:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430929.635842:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856181120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430929.635883:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856181120:12345-0@lo:400:kworker.0 Request processed in 43us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430929.635890:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787430929.635906:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787430929.635915:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856181248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430929.635947:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874256856181248:12345-0@lo:400:kworker.0 Request processed in 34us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430929.635954:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787430929.635991:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856180864:0@lo:400:kworker.0 00000100:00100000:3.0:1787430929.636004:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec3bb70-eba8-428d-9804-5196e7d74be3:3310:1874256856180736:0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.636012:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1874256856181376:0@lo:400:kworker.0 00000100:00100000:3.0:1787430929.636025:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1874256856181248:0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.636054:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856181504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787430929.636067:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1874256856180992:0@lo:400:kworker.0 00000100:00100000:3.0:1787430929.636882:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856181632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787430929.636901:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856181120:0@lo:400:kworker.0 00000100:00100000:1.0:1787430929.945732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945902:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945952:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430929.945991:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519744 00000100:00100000:1.0:1787430929.946004:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519744 00000100:00100000:1.0:1787430929.946069:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:1.0:1787430929.946081:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ef263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:2373:x1874256841519744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430929.946097:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520128 00000100:00100000:0.0:1787430929.946103:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520128 00000100:00100000:1.0:1787430929.946176:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ef263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:2373:x1874256841519744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430929.946184:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:1.0:1787430929.946226:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520384 00000100:00100000:1.0:1787430929.946231:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520384 00000100:00100000:0.0:1787430929.946234:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520000 00000100:00100000:0.0:1787430929.946250:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520000 00000100:00100000:1.0:1787430929.946271:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520512 00000100:00100000:1.0:1787430929.946280:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520512 00000100:00100000:0.0:1787430929.946281:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:0.0:1787430929.946295:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2373:x1874256841520128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787430929.946310:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:1.0:1787430929.946319:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2373:x1874256841520384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430929.946377:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2373:x1874256841520128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 85us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430929.946397:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2373:x1874256841520384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 79us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430929.946414:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430929.946467:0:16071:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787430929.946479:0:16071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787430929.946729:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841519872 00000100:00100000:3.0:1787430929.946735:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841519872 00000100:00100000:3.0:1787430929.946771:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520256 00000100:00100000:3.0:1787430929.946774:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520256 00000100:00100000:3.0:1787430929.946797:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430929.946805:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841519872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430929.946846:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841519872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430929.946862:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430929.946877:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:3.0:1787430929.946883:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2373:x1874256841520256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430929.946926:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2373:x1874256841520256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430929.946932:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:0.0:1787430929.947250:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:0.0:1787430929.947270:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:0.0:1787430929.947279:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2373:x1874256841520000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430929.947309:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2373:x1874256841520000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430929.947316:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:0.0:1787430929.947352:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:0.0:1787430929.947361:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2373:x1874256841520512:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430929.947387:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2373:x1874256841520512:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430929.947394:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00080000:0.0:1787430929.947782:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787430929.947788:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787430929.947791:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1787430930.333504:0:16484:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9a3e2460 20000000:00000080:3.0:1787430930.333520:0:16484:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0f2c2f9b400 uarg=0000000000000000 20000000:01000000:3.0:1787430930.333556:0:16484:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787430930.333562:0:16484:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787430930.333566:0:16484:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787430930.335085:0:16485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787430930.335860:0:16484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787430930.345619:0:16484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787430930.345652:0:16484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345671:0:16484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345680:0:16484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345688:0:16484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345715:0:16484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345723:0:16484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345731:0:16484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345780:0:16484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345794:0:16484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 12 pid: 14368 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.345820:0:16484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856181760:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430930.345937:0:16484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345946:0:16484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.345955:0:16484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856181888:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430930.345991:0:16484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.345999:0:16484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 18 pid: 14369 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.346022:0:16484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856182016:0@lo:104: 00000100:00100000:0.0:1787430930.346062:0:16484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430930.346109:0:16484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.346118:0:16484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 18 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.346125:0:16484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856182144:0@lo:104: 00000100:00100000:0.0:1787430930.346148:0:16484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787430930.346184:0:16484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.346192:0:16484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 18 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.346200:0:16484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856182272:0@lo:104: 00000100:00100000:0.0:1787430930.346226:0:16484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430930.346247:0:16484:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c75a3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787430930.346607:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787430930.346618:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182016 00000100:00100000:2.0:1787430930.346623:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182016 00000100:00100000:2.0:1787430930.346655:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182144 00000100:00100000:2.0:1787430930.346656:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182144 00000100:00100000:2.0:1787430930.346661:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182272 00000100:00100000:2.0:1787430930.346662:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182272 00000100:00100000:2.0:1787430930.346671:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787430930.346677:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+5:16484:x1874256856182016:12345-0@lo:104: 00010000:00010000:2.0:1787430930.346687:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346738:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787430930.346743:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+5:16484:x1874256856182016:12345-0@lo:104: Request processed in 66us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430930.346747:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787430930.346759:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430930.346762:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+4:16484:x1874256856182144:12345-0@lo:104: 00010000:00010000:2.0:1787430930.346775:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346798:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787430930.346801:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+4:16484:x1874256856182144:12345-0@lo:104: Request processed in 39us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430930.346805:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430930.346813:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430930.346816:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2feebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:16484:x1874256856182272:12345-0@lo:104: 00010000:00010000:2.0:1787430930.346820:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346834:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787430930.346836:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2feebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+3:16484:x1874256856182272:12345-0@lo:104: Request processed in 21us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430930.346839:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787430930.346866:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787430930.346869:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346874:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430930.346877:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346883:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430930.346888:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430930.346897:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787430930.346921:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346926:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430930.346941:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346945:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c74e00/0x1fa5b1e070e69f3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69f44 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346953:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787430930.346955:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346958:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75400 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430930.346959:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.346963:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430930.346967:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787430930.346970:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787430930.346978:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.346983:0:14363:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430930.346990:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787430930.347014:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787430930.347015:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347022:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c4c75400/0x1fa5b1e070e69ecd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69ed4 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347028:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430930.347030:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430930.347031:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430930.347034:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856182400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787430930.347043:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856182528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787430930.347078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430930.347131:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182400 00000100:00100000:3.0:1787430930.347135:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182400 00010000:00010000:3.0:1787430930.347157:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 19 pid: 14369 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430930.347172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430930.347538:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182528 00000100:00100000:3.0:1787430930.347543:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182528 00000100:00100000:2.0:1787430930.347551:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787430930.347563:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 20 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430930.347565:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+20:3309:x1874256856182400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430930.347581:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787430930.347587:0:14362:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787430930.347590:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 20 pid: 14369 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430930.347596:0:14362:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787430930.347606:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 20 pid: 14369 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347623:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430930.347657:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+20:3309:x1874256856182400:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430930.347665:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787430930.347682:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430930.347689:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3307:x1874256856182528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430930.347696:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430930.347702:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 19 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347717:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 19 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430930.347729:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec3bb70-eba8-428d-9804-5196e7d74be3:3309:1874256856182400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430930.347729:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430930.347765:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3307:x1874256856182528:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430930.347773:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787430930.347805:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856182528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430930.347847:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430930.347853:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347861:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263a00 already unused, calling callback (ffffffffc1bc6c20) 10000000:00010000:2.0:1787430930.347865:0:14363:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347872:0:14363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787430930.347879:0:14363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.347881:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430930.347886:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787430930.347890:0:14363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787430930.347915:0:14363:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347922:0:14363:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787430930.347936:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430930.347941:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856182656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787430930.347959:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e69e80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1fa5b1e070e69e87 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.347975:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430930.347977:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430930.347980:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430930.347982:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430930.348007:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182656 00000100:00100000:2.0:1787430930.348012:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182656 00010000:00010000:2.0:1787430930.348029:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 19 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430930.348267:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787430930.348276:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3308:x1874256856182656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787430930.348285:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430930.348291:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 19 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.348301:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 19 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.348311:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430930.348427:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3308:x1874256856182656:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430930.348435:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787430930.348547:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec3bb70-eba8-428d-9804-5196e7d74be3:3308:1874256856182656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787430930.349568:0:16484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147a000/0x1fa5b1e070e69f44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69f3d expref: 18 pid: 14369 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.349584:0:16484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856182016:0@lo:104: 00010000:00010000:0.0:1787430930.349596:0:16484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74200/0x1fa5b1e070e69ed4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69ecd expref: 17 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.349604:0:16484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856182144:0@lo:104: 00010000:00010000:0.0:1787430930.349613:0:16484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c75000/0x1fa5b1e070e69e87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1fa5b1e070e69e80 expref: 16 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430930.349634:0:16484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856182272:0@lo:104: 00000100:00100000:1.0:1787430930.352733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430930.352900:0:16484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856181760:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430930.352914:0:16484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16484:1874256856181888:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430930.352951:0:16484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430930.353027:0:16487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520640 00000100:00100000:3.0:1787430930.353035:0:16487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520640 00010000:00010000:3.0:1787430930.353069:0:16487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 13 pid: 14368 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430930.353190:0:16487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:3.0:1787430930.353200:0:16487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:2373:x1874256841520640:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787430930.353215:0:16487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430930.353222:0:16487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 13 pid: 14368 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.353265:0:16487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 13 pid: 14368 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.353283:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c147b800/0x1fa5b1e070e6a166 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149c1 expref: 13 pid: 14368 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430930.353298:0:16487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787430930.353374:0:16487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:2373:x1874256841520640:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 175us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430930.353381:0:16487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:1.0:1787430930.354036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430930.354165:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520768 00000100:00100000:2.0:1787430930.354171:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520768 00010000:00010000:2.0:1787430930.354195:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430930.354271:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430930.354281:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:2371:x1874256841520768:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430930.354292:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430930.354297:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354309:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354322:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c4c74800/0x1fa5b1e070e6a12e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc1495f expref: 12 pid: 14370 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354391:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354398:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354413:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354534:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354541:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354547:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354553:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430930.354557:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354565:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354584:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.354594:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430930.354638:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:2371:x1874256841520768:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 357us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430930.354653:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00010000:00010000:0.0:1787430930.354711:0:16484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.354720:0:16484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430930.354726:0:16484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0f2c5262400/0x1fa5b1e070e6a190 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430930.588830:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787430931.612795:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430931.804286:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430931.810244:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841520896 00000100:00100000:2.0:1787430931.810265:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841520896 00000100:00100000:2.0:1787430931.810349:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:2.0:1787430931.810362:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+11:13747:x1874256841520896:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430931.810378:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430931.810401:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e6a197 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc149f2 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430931.810513:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e6a197 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149f2 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430931.810526:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75c00/0x1fa5b1e070e6a197 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149f2 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430931.810836:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75c00, rc 0) 00000100:00100000:2.0:1787430931.812098:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13747:x1874256841520896:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 1723us (7805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430931.812108:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:2.0:1787430931.824725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430931.828051:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521024 00000100:00100000:3.0:1787430931.828065:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521024 00000100:00100000:3.0:1787430931.828165:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:3.0:1787430931.828176:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13747:x1874256841521024:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430931.828497:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13747:x1874256841521024:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 321us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430931.828506:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:2.0:1787430931.837214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430931.837669:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521152 00000100:00100000:3.0:1787430931.837681:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521152 00000100:00100000:3.0:1787430931.837775:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00100000:3.0:1787430931.837785:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13747:x1874256841521152:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430931.837995:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13747:x1874256841521152:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 210us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430931.838004:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00100000:1.0:1787430931.846319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430931.847266:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521280 00000100:00100000:3.0:1787430931.847276:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521280 00000100:00100000:3.0:1787430931.847407:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 106 00000100:00100000:3.0:1787430931.847418:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+12:13747:x1874256841521280:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430931.847434:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430931.847450:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e6a19e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc149f9 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430931.847479:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e6a19e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149f9 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430931.847490:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c147b600/0x1fa5b1e070e6a19e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149f9 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430931.847499:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147b600, rc 0) 00000100:00100000:3.0:1787430931.847566:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13747:x1874256841521280:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 149us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430931.847574:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 106 00000100:00100000:0.0:1787430931.850819:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430931.850875:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521408 00000100:00100000:2.0:1787430931.850886:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521408 00000100:00100000:2.0:1787430931.850938:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:2.0:1787430931.850948:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13747:x1874256841521408:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430931.851235:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13747:x1874256841521408:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 287us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430931.851250:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:0.0:1787430931.856501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430931.856618:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521536 00000100:00100000:3.0:1787430931.856630:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521536 00000100:00100000:3.0:1787430931.856687:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:3.0:1787430931.856698:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13747:x1874256841521536:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430931.856987:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:13747:x1874256841521536:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 290us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430931.856996:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 108 10000000:01000000:3.0:1787430932.060500:0:14372:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430932.060509:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2ec24b800 from 10 10000000:01000000:3.0:1787430932.060515:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430932.060582:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.060595:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.060621:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430932.060657:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856182784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.060737:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430932.060811:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182784 00000100:00100000:3.0:1787430932.060813:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d07af600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430932.060820:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182784 00000100:00100000:2.0:1787430932.060870:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787430932.060879:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+16:14372:x1874256856182784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430932.060892:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430932.060908:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75a00/0x1fa5b1e070e6a1ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e6a1a5 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.060933:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75a00/0x1fa5b1e070e6a1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e6a1a5 expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.060943:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75a00/0x1fa5b1e070e6a1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e6a1a5 expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.060952:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75a00, rc 0) 00000100:00100000:2.0:1787430932.060994:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:14372:x1874256856182784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430932.061000:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787430932.061090:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856182784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787430932.061105:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1ac expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.061114:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e6a1ac expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430932.061164:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856182912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.061191:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430932.061225:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d07af600 going to sleep for 11 seconds 00000100:00100000:0.0:1787430932.061256:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856182912 00000100:00100000:0.0:1787430932.061261:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856182912 00000100:00100000:0.0:1787430932.061297:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787430932.061305:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:14372:x1874256856182912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787430932.063491:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:14372:x1874256856182912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2180us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430932.063504:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787430932.063638:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856182912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.063687:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.063732:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430932.063851:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d07af600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430932.064007:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183040 00000100:00100000:2.0:1787430932.064014:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183040 00000100:00100000:2.0:1787430932.064193:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787430932.064213:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:14372:x1874256856183040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430932.064453:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:14372:x1874256856183040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430932.064467:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787430932.064567:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787430932.065615:0:16596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787430932.065863:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787430932.065885:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787430932.065894:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1ac expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430932.065913:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147b800/0x1fa5b1e070e6a1a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1ac expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787430932.065923:0:14372:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787430932.065925:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f2fe8a8000 from 10 10000000:01000000:0.0:1787430932.065928:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787430932.065956:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430932.065963:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430932.065973:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430932.065990:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.066031:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430932.066067:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430932.066740:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183168 00000100:00100000:2.0:1787430932.066747:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183168 00000100:00100000:2.0:1787430932.066840:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787430932.066850:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+17:14372:x1874256856183168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430932.066861:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430932.066874:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e6a1ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e6a1b3 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.066895:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e6a1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e6a1b3 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.066904:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c74a00/0x1fa5b1e070e6a1ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e6a1b3 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.066912:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74a00, rc 0) 00000100:00100000:2.0:1787430932.066956:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856183168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430932.066962:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787430932.067035:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430932.067047:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1ba expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430932.067056:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e6a1ba expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430932.067099:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.067122:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430932.067729:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787430932.068669:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183296 00000100:00100000:3.0:1787430932.068687:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183296 00000100:00100000:3.0:1787430932.068730:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787430932.068739:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856183296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.068993:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856183296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430932.068999:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787430932.069136:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.069177:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.069228:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430932.069256:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c56016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430932.069303:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183424 00000100:00100000:1.0:1787430932.069384:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183424 00000100:00100000:1.0:1787430932.069450:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787430932.069458:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856183424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787430932.069596:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856183424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430932.069612:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787430932.069751:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787430932.070954:0:16597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787430932.071120:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787430932.071137:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787430932.071146:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1ba expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.071157:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c5263a00/0x1fa5b1e070e6a1b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1ba expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787430932.071167:0:14372:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787430932.071169:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0f1c733e800 from 10 10000000:01000000:3.0:1787430932.071172:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787430932.071197:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.071216:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.071225:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430932.071243:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.071283:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787430932.071517:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2d07af480 going to sleep for 11 seconds 00000100:00100000:2.0:1787430932.071568:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183552 00000100:00100000:2.0:1787430932.071573:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183552 00000100:00100000:2.0:1787430932.071674:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787430932.071682:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+18:14372:x1874256856183552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787430932.071693:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430932.071706:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0f2c4c75200/0x1fa5b1e070e6a1c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1fa5b1e070e6a1c1 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.071725:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0f2c4c75200/0x1fa5b1e070e6a1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1fa5b1e070e6a1c1 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.071743:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0f2c4c75200/0x1fa5b1e070e6a1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1fa5b1e070e6a1c1 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.071752:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75200, rc 0) 00000100:00100000:2.0:1787430932.071827:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856183552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430932.071834:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787430932.071933:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787430932.071946:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1c8 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430932.071954:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1fa5b1e070e6a1c8 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430932.071994:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.072019:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430932.072079:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601600 going to sleep for 11 seconds 00000100:00100000:3.0:1787430932.072162:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183680 00000100:00100000:3.0:1787430932.072172:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183680 00000100:00100000:3.0:1787430932.072244:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787430932.072252:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856183680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787430932.072478:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856183680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430932.072486:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787430932.072546:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.072571:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787430932.072617:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430932.072827:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c5601600 going to sleep for 11 seconds 00000100:00100000:2.0:1787430932.072879:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856183808 00000100:00100000:2.0:1787430932.072883:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856183808 00000100:00100000:2.0:1787430932.072901:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787430932.072907:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856183808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787430932.073043:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:14372:x1874256856183808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430932.073050:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787430932.073115:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec3bb70-eba8-428d-9804-5196e7d74be3:14372:1874256856183808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787430932.074038:0:16598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787430932.074261:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787430932.074279:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787430932.074286:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1c8 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.074296:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffffa0f2c147a200/0x1fa5b1e070e6a1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1fa5b1e070e6a1c8 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430932.637515:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430932.973497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430932.973692:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521664 00000100:00100000:3.0:1787430932.973703:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521664 00000100:00100000:3.0:1787430932.973838:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430932.973849:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:14400:x1874256841521664:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430932.973874:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430932.973896:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a1cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a00 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.973961:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.973974:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.973985:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974000:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974007:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974014:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974528:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ca00/0x1fa5b1e070e6a1e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974538:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ca00/0x1fa5b1e070e6a1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974547:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ca00/0x1fa5b1e070e6a1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430932.974639:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787430932.974643:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430932.974735:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ca00/0x1fa5b1e070e6a1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974747:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974754:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974761:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974766:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147bc00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430932.974770:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974777:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974789:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:3.0:1787430932.974798:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430932.974802:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974810:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a1d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974822:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974828:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974833:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974837:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d600 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430932.974839:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974845:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974852:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0f2daf05600) 00010000:00010000:3.0:1787430932.974854:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430932.974857:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974861:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974891:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a1cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a00 expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974916:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ca00/0x1fa5b1e070e6a1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a00 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.974923:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0f2daf05200) 00010000:00010000:3.0:1787430932.974925:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430932.974927:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216ca00, rc 0) 00000100:00100000:3.0:1787430932.974999:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:14400:x1874256841521664:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1152us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430932.975007:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00080000:0.0:1787430932.976149:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787430932.982607:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430932.982750:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841521920 00000100:00100000:3.0:1787430932.982760:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841521920 00000100:00100000:3.0:1787430932.983106:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:3.0:1787430932.983118:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:14400:x1874256841521920:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430932.983148:0:16446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430932.983170:0:16446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a07 expref: -99 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983253:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983267:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983279:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983306:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983361:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983369:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983926:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216cc00/0x1fa5b1e070e6a200 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983936:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216cc00/0x1fa5b1e070e6a200 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.983943:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216cc00/0x1fa5b1e070e6a200 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430932.983952:0:16446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787430932.984223:0:16446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984231:0:16446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984238:0:16446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984244:0:16446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430932.984248:0:16446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984255:0:16446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984276:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0f2daf05200) 00010000:00010000:3.0:1787430932.984279:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430932.984284:0:16446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984289:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a1f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984302:0:16446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984308:0:16446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984313:0:16446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984318:0:16446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216ce00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430932.984321:0:16446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984433:0:16446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984442:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0f2daf05600) 00010000:00010000:3.0:1787430932.984444:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430932.984447:0:16446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984452:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a1f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984830:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a1eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a07 expref: 10 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984846:0:16446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216cc00/0x1fa5b1e070e6a200 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a07 expref: 9 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430932.984853:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2daf05500) 00010000:00010000:3.0:1787430932.984855:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430932.984857:0:16446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216cc00, rc 0) 00000100:00100000:3.0:1787430932.984934:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14400:x1874256841521920:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 1817us (2335us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787430932.984943:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:1.0:1787430932.988099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430932.988561:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522048 00000100:00100000:3.0:1787430932.988572:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522048 00000100:00100000:3.0:1787430932.988692:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:3.0:1787430932.988704:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14400:x1874256841522048:12345-192.168.204.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787430932.988830:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14400:x1874256841522048:12345-192.168.204.60@tcp:59:lhsmtool_posix.0 Request processed in 127us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430932.988838:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:2.0:1787430933.047664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.047782:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522176 00000100:00100000:0.0:1787430933.047799:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522176 00000100:00100000:0.0:1787430933.047902:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:0.0:1787430933.047913:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14406:x1874256841522176:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430933.047932:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.047958:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a20e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a0e expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048030:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048045:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048058:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048073:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048081:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048089:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048459:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048468:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048486:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048493:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.048497:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048505:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048517:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:0.0:1787430933.048521:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.048525:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048532:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048545:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048551:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048557:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048562:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.048565:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048582:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048591:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0f2dac6b200) 00010000:00010000:0.0:1787430933.048594:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.048597:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048603:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a21c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048635:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a20e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a0e expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048645:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:0.0:1787430933.048647:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.048651:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a20e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a0e expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.048660:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262800, rc 0) 00000100:00100000:0.0:1787430933.048745:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14406:x1874256841522176:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 833us (1097us total) trans 0 rc 301/301 00000100:00100000:0.0:1787430933.048753:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:0.0:1787430933.060918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430933.061292:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522304 00000100:00100000:1.0:1787430933.061305:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522304 00000100:00100000:1.0:1787430933.061444:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787430933.061457:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14406:x1874256841522304:12345-192.168.204.60@tcp:700:lfs.0 00000100:00100000:1.0:1787430933.061592:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14406:x1874256841522304:12345-192.168.204.60@tcp:700:lfs.0 Request processed in 137us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.061599:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787430933.066144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.066292:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522560 00000100:00100000:2.0:1787430933.066305:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522560 00000100:00100000:2.0:1787430933.066471:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:2.0:1787430933.066484:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14406:x1874256841522560:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:2.0:1787430933.066572:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430933.066613:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14989 expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.066637:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:2.0:1787430933.066643:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787430933.067030:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.067046:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 5 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.067055:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.067096:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 5 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.067114:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 5 pid: 14375 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.067130:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14377:1874256856183936:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430933.067281:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c5216180 going to sleep for 11 seconds 00000100:00100000:2.0:1787430933.071759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.071823:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14377:1874256856183936:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787430933.072061:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522688 00000100:00100000:1.0:1787430933.072074:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522688 00010000:00010000:3.0:1787430933.072083:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787430933.072160:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787430933.072204:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 6 pid: 14375 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.072251:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:1.0:1787430933.072264:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2374:x1874256841522688:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430933.072300:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430933.072308:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 6 pid: 14375 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.072323:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 6 pid: 14375 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.072381:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc149eb expref: 6 pid: 14375 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.072401:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:1.0:1787430933.072407:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.072418:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.072425:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.072536:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430933.072600:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2374:x1874256841522688:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 338us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.072608:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00010000:00010000:2.0:1787430933.073225:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.073250:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.073283:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.073294:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.073304:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430933.076943:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787430933.076968:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.076980:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.076990:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.076996:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430933.077002:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.077011:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.077033:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2c65a8000) 00010000:00010000:2.0:1787430933.077036:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430933.077050:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.077056:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a223 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787430933.077083:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e92b299 reply state 0000000000cc8545 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.077093:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787430933.077246:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+10:14406:x1874256841522560:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 10759us (11111us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787430933.077257:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00010000:00010000:3.0:1787430933.080965:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.081445:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.081454:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.081460:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c75000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.081466:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.081475:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.081733:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0f2d22f0400) 00010000:00010000:3.0:1787430933.081739:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430933.081746:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.081753:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a22a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430933.156464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.156592:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522816 00000100:00100000:3.0:1787430933.156606:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522816 00000100:00100000:3.0:1787430933.156721:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:3.0:1787430933.156735:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:14414:x1874256841522816:12345-192.168.204.60@tcp:101:lctl.0 00010000:00010000:3.0:1787430933.156772:0:16446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.156815:0:16446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a15 expref: -99 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.156939:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.156956:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.156970:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430933.157048:0:16446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787430933.157065:0:16446:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430933.157116:0:16446:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.157147:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a15 expref: 11 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.157170:0:16446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216ce00/0x1fa5b1e070e6a238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a15 expref: 10 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.157188:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430933.157191:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430933.157196:0:16446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216ce00, rc 0) 00000100:00100000:3.0:1787430933.157277:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+10:14414:x1874256841522816:12345-192.168.204.60@tcp:101:lctl.0 Request processed in 545us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430933.157285:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:2.0:1787430933.179830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.179938:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841522944 00000100:00100000:3.0:1787430933.179952:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841522944 00000100:00100000:3.0:1787430933.180044:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:3.0:1787430933.180056:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:14415:x1874256841522944:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430933.180081:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.180106:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a1c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.180216:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.180234:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.180249:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430933.180392:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787430933.180397:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787430933.180436:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.180467:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a1c expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.180490:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d000/0x1fa5b1e070e6a246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a1c expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.180500:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430933.180504:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787430933.180508:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216d000, rc 0) 00000100:00100000:3.0:1787430933.180593:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:14415:x1874256841522944:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 539us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430933.180607:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:2.0:1787430933.185281:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.185535:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841523072 00000100:00100000:0.0:1787430933.185548:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841523072 00000100:00100000:0.0:1787430933.185628:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:0.0:1787430933.185640:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:14415:x1874256841523072:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430933.185665:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.185690:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a24d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a23 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.185771:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.185787:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.185801:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.185817:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.185824:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.185831:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188520:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a262 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188543:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188556:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.188709:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787430933.188713:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430933.188742:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188756:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188762:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188769:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188774:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.188778:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188785:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188799:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:0.0:1787430933.188802:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.188806:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188812:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a254 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188826:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188837:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188841:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188844:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.188845:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188849:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188854:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0f2dac6b200) 00010000:00010000:0.0:1787430933.188856:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.188857:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188861:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a25b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188893:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a24d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a23 expref: 8 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188902:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a262 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a23 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.188907:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b300) 00010000:00010000:0.0:1787430933.188909:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430933.188913:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430933.188977:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+7:14415:x1874256841523072:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 3338us (3708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.188983:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:0.0:1787430933.195106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.195202:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841523328 00000100:00100000:3.0:1787430933.195213:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841523328 00000100:00100000:3.0:1787430933.195284:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:3.0:1787430933.195295:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+7:14415:x1874256841523328:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430933.195318:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.195373:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a2a expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430933.195491:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787430933.195608:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a269 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a2a expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.195624:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430933.195627:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430933.195632:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a2a expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.195645:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216d600, rc 0) 00000100:00100000:3.0:1787430933.195705:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+8:14415:x1874256841523328:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 412us (618us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787430933.195712:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:2.0:1787430933.199371:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.199444:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841523584 00000100:00100000:3.0:1787430933.199455:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841523584 00000100:00100000:3.0:1787430933.199560:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:3.0:1787430933.199572:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1b61aeb-d968-445f-98a2-5f2b7302c59a+8:14415:x1874256841523584:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:3.0:1787430933.199651:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787430933.199677:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a262 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a23 expref: 8 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.199695:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b300) 00010000:00010000:3.0:1787430933.199705:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787430933.199730:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.199743:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.199752:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787430933.200111:0:16446:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000781c3c59 reply state 00000000e6c81578 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430933.200121:0:16446:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787430933.200134:0:16446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787430933.200259:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1b61aeb-d968-445f-98a2-5f2b7302c59a+9:14415:x1874256841523584:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 689us (897us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787430933.200264:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 24 00010000:00010000:3.0:1787430933.202522:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.202533:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.202539:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.202547:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216c000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.202550:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.202555:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.202567:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2daf05700) 00010000:00010000:3.0:1787430933.202569:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787430933.202572:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.202576:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216c000/0x1fa5b1e070e6a277 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.203534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.203630:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841523840 00000100:00100000:0.0:1787430933.203640:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841523840 00000100:00100000:0.0:1787430933.203730:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787430933.203740:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+8:14415:x1874256841523840:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787430933.204001:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+9:14415:x1874256841523840:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 262us (471us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787430933.204010:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:2.0:1787430933.207234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.207359:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841524096 00000100:00100000:3.0:1787430933.207368:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841524096 00000100:00100000:3.0:1787430933.207616:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:3.0:1787430933.207627:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+9:14415:x1874256841524096:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430933.207650:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.207670:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a31 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.207741:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.207754:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.207766:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.207792:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.207799:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.207806:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430933.208856:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787430933.208971:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.208980:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.208987:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.208993:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.208997:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209005:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209018:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430933.209021:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430933.209026:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209043:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d200/0x1fa5b1e070e6a285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209168:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209175:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209191:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209197:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.209200:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209206:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209214:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0f2daf05300) 00010000:00010000:3.0:1787430933.209217:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430933.209220:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209227:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a28c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209276:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a27e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a31 expref: 11 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209300:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430933.209303:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430933.209307:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a31 expref: 11 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.209317:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f30216d600, rc 0) 00000100:00100000:3.0:1787430933.209546:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+10:14415:x1874256841524096:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1920us (2319us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787430933.209555:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:1.0:1787430933.215298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.215415:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841524224 00000100:00100000:0.0:1787430933.215425:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841524224 00000100:00100000:0.0:1787430933.215476:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:0.0:1787430933.215486:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+10:14415:x1874256841524224:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787430933.215512:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.215535:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a29a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a38 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.215625:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.215638:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.215650:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.215719:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787430933.215723:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430933.215745:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.215770:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a29a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.215788:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.215797:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b200) 00010000:00010000:0.0:1787430933.215800:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787430933.215804:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262a00, rc 0) 00000100:00100000:0.0:1787430933.215862:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+11:14415:x1874256841524224:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 377us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.215869:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:2.0:1787430933.221644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.221714:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841524352 00000100:00100000:0.0:1787430933.221726:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841524352 00000100:00100000:0.0:1787430933.221784:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:0.0:1787430933.221798:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+11:14415:x1874256841524352:12345-192.168.204.60@tcp:37:lfs.0 00000100:00100000:0.0:1787430933.228232:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1b61aeb-d968-445f-98a2-5f2b7302c59a+11:14415:x1874256841524352:12345-192.168.204.60@tcp:37:lfs.0 Request processed in 6430us (6588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.228245:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:1.0:1787430933.235738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.235842:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841524608 00000100:00100000:2.0:1787430933.235852:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841524608 00000100:00100000:2.0:1787430933.235920:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:2.0:1787430933.235932:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdd5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+11:14415:x1874256841524608:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430933.236201:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdd5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+12:14415:x1874256841524608:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 271us (472us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787430933.236209:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:2.0:1787430933.276449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.276983:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841524736 00000100:00100000:0.0:1787430933.276993:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841524736 00000100:00100000:0.0:1787430933.277063:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:0.0:1787430933.277073:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+10:14421:x1874256841524736:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430933.277094:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.277114:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a3f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277194:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277208:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277219:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277236:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277243:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277250:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277388:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a2bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277397:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a2bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277404:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a2bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.277444:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787430933.277447:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430933.277482:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a2bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277493:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277500:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277507:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277512:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.277516:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277523:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277534:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:0.0:1787430933.277537:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.277541:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277547:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277558:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277572:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277578:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277583:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.277586:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277592:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277599:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0f2dac6ba00) 00010000:00010000:0.0:1787430933.277601:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.277603:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277609:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277639:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a3f expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277652:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262c00/0x1fa5b1e070e6a2bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a3f expref: 11 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.277660:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b200) 00010000:00010000:0.0:1787430933.277662:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787430933.277669:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262c00, rc 0) 00000100:00100000:0.0:1787430933.277727:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+11:14421:x1874256841524736:12345-192.168.204.60@tcp:101:bash.0 Request processed in 656us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.277735:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:0.0:1787430933.280571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.280641:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841524992 00000100:00100000:3.0:1787430933.280650:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841524992 00000100:00100000:3.0:1787430933.280698:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:3.0:1787430933.280707:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+11:14421:x1874256841524992:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787430933.280726:0:16446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.280745:0:16446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a2c4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a46 expref: -99 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.280969:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.280984:0:16446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.280993:0:16446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.281025:0:16446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.281053:0:16446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 11 pid: 14376 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430933.281066:0:16446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c4c98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16446:1874256856184064:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430933.281481:0:16446:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c531d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787430933.286761:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.286870:0:16446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c4c98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16446:1874256856184064:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787430933.286937:0:16446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.288400:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841525120 00000100:00100000:2.0:1787430933.288410:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841525120 00010000:00010000:2.0:1787430933.288467:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 12 pid: 14376 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.288513:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:2.0:1787430933.288523:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+12:2373:x1874256841525120:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430933.288539:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430933.288546:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 12 pid: 14376 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.288559:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 12 pid: 14376 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.288581:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a2a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a38 expref: 12 pid: 14376 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.288596:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b200) 00010000:00010000:2.0:1787430933.288601:0:14361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.288610:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.288617:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.288640:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430933.288703:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1b61aeb-d968-445f-98a2-5f2b7302c59a+11:2373:x1874256841525120:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 182us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430933.288711:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00010000:00010000:0.0:1787430933.290724:0:16446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.290739:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.290768:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.290780:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.290788:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292001:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292014:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292024:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.292035:0:16446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787430933.292057:0:16446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292075:0:16446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292082:0:16446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292088:0:16446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a000 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.292092:0:16446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292099:0:16446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292111:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b200) 00010000:00010000:0.0:1787430933.292113:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430933.292117:0:16446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292122:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a2cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430933.292214:0:16446:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e191a209 reply state 00000000ee1bc8ce transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430933.292225:0:16446:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787430933.292321:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a2c4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 14 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292401:0:16446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 13 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.292419:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.292422:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787430933.292424:0:16446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263800, rc 0) 00000100:00100000:0.0:1787430933.292530:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:14421:x1874256841524992:12345-192.168.204.60@tcp:101:bash.0 Request processed in 11822us (11966us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787430933.292539:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00010000:00010000:3.0:1787430933.298735:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.298750:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.298755:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.298759:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.298763:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.298768:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.298782:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0f2dac6ba00) 00010000:00010000:3.0:1787430933.298785:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430933.298802:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.298806:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a2d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.306319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.306520:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841525248 00000100:00100000:0.0:1787430933.306530:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841525248 00000100:00100000:0.0:1787430933.306626:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:0.0:1787430933.306638:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+13:14421:x1874256841525248:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787430933.306675:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.306696:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a4d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306764:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306784:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306795:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.306834:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787430933.306839:0:14375:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787430933.306858:0:14375:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306887:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306925:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a2e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306942:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 14 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.306952:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.306955:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430933.306958:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262400, rc 0) 00000100:00100000:0.0:1787430933.307021:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:14421:x1874256841525248:12345-192.168.204.60@tcp:101:bash.0 Request processed in 385us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.307028:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:0.0:1787430933.310412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.310512:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841525504 00000100:00100000:2.0:1787430933.310521:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841525504 00000100:00100000:2.0:1787430933.310586:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787430933.310597:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:14421:x1874256841525504:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:2.0:1787430933.310964:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+15:14421:x1874256841525504:12345-192.168.204.60@tcp:35:bash.0 Request processed in 368us (562us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787430933.310974:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787430933.372678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.372756:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841525760 00000100:00100000:3.0:1787430933.372768:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841525760 00000100:00100000:3.0:1787430933.372839:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:3.0:1787430933.372851:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+15:14431:x1874256841525760:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430933.372876:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.372896:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a2f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a54 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430933.373011:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787430933.373132:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a2f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a54 expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.373148:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0f2daf05600) 00010000:00010000:3.0:1787430933.373151:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787430933.373156:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a2f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a54 expref: 17 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.373170:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430933.373249:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+16:14431:x1874256841525760:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 400us (582us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787430933.373256:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:1.0:1787430933.377270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.377365:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841526016 00000100:00100000:2.0:1787430933.377376:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841526016 00000100:00100000:2.0:1787430933.377450:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787430933.377460:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+16:14431:x1874256841526016:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430933.377712:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+17:14431:x1874256841526016:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 252us (452us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787430933.377720:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787430933.412971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.413077:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841526272 00000100:00100000:3.0:1787430933.413086:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841526272 00000100:00100000:3.0:1787430933.413311:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:3.0:1787430933.413323:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+17:14434:x1874256841526272:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787430933.413376:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.413397:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a303 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a5b expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.413502:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a30a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.413517:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a30a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.413530:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a30a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787430933.413541:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787430933.413670:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a303 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a5b expref: 20 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.413689:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a30a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a5b expref: 19 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.413699:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:3.0:1787430933.413703:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787430933.413706:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430933.413774:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:14434:x1874256841526272:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 453us (813us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787430933.413782:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:3.0:1787430933.417109:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.417198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.417270:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841526528 00000100:00100000:0.0:1787430933.417280:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841526528 00000100:00100000:0.0:1787430933.417488:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:0.0:1787430933.417500:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:14434:x1874256841526528:12345-192.168.204.60@tcp:54:lfs.0 00000100:00100000:1.0:1787430933.417541:0:16487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841526400 00000100:00100000:1.0:1787430933.417547:0:16487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841526400 00010000:00010000:0.0:1787430933.417573:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.417590:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.417596:0:16487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00010000:00010000:0.0:1787430933.417609:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.417610:0:16487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+20:2371:x1874256841526400:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430933.417626:0:16487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430933.417648:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a30a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a5b expref: 20 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.417658:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.417667:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.417675:0:16487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:1.0:1787430933.417682:0:16487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430933.417684:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.417692:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.417698:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.417707:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.417718:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.417721:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430933.417725:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.417785:0:16487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:2371:x1874256841526400:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 178us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.417793:0:16487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00010000:00010000:0.0:1787430933.417868:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a318 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430933.417907:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+18:14434:x1874256841526528:12345-192.168.204.60@tcp:54:lfs.0 Request processed in 410us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.417914:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:1.0:1787430933.420596:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.420658:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841526784 00000100:00100000:2.0:1787430933.420666:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841526784 00000100:00100000:2.0:1787430933.420738:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430933.420747:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+18:14434:x1874256841526784:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787430933.420970:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:14434:x1874256841526784:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 224us (380us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787430933.420977:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787430933.615431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.615538:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841527040 00000100:00100000:0.0:1787430933.615548:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841527040 00000100:00100000:0.0:1787430933.615607:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:0.0:1787430933.615631:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:14465:x1874256841527040:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:0.0:1787430933.615659:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.615679:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a31f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a62 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.615780:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a326 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.615794:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.615807:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a326 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.615819:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787430933.615960:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a31f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a62 expref: 22 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.615978:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a326 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a62 expref: 21 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.615986:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.615989:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787430933.615992:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262e00, rc 0) 00000100:00100000:0.0:1787430933.617195:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+21:14465:x1874256841527040:12345-192.168.204.60@tcp:101:cat.0 Request processed in 1561us (1769us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787430933.617206:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:3.0:1787430933.624714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.624773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.625014:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841527296 00000100:00100000:0.0:1787430933.625028:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841527296 00000100:00100000:0.0:1787430933.625126:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:0.0:1787430933.625137:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+21:14465:x1874256841527296:12345-192.168.204.60@tcp:35:cat.0 00000100:00100000:0.0:1787430933.625500:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+22:14465:x1874256841527296:12345-192.168.204.60@tcp:35:cat.0 Request processed in 363us (799us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787430933.625508:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787430933.625698:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841527424 00000100:00100000:2.0:1787430933.625703:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841527424 00000100:00100000:2.0:1787430933.625763:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:2.0:1787430933.625771:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+22:2372:x1874256841527424:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787430933.625783:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787430933.625808:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a326 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a62 expref: 22 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.625826:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:2.0:1787430933.625831:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787430933.625912:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+21:2372:x1874256841527424:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 141us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430933.625919:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00010000:00010000:2.0:1787430933.660655:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787430933.682832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.683366:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841527680 00000100:00100000:2.0:1787430933.683377:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841527680 00000100:00100000:2.0:1787430933.683455:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:2.0:1787430933.683467:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+21:14471:x1874256841527680:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787430933.683493:0:16446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430933.683515:0:16446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a334 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a69 expref: -99 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683643:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683659:0:16446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 22 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683667:0:16446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 22 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683697:0:16446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683734:0:16446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 22 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683749:0:16446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 22 pid: 14375 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.683763:0:16446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16446:1874256856184192:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430933.683881:0:16446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 22 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.683891:0:16446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 22 pid: 16446 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430933.683901:0:16446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16446:1874256856184320:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430933.683924:0:16446:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f1c5216f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430933.686089:0:16446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16446:1874256856184192:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787430933.687672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.687718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.687934:0:16446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16446:1874256856184320:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787430933.687976:0:16446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.688699:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841527808 00000100:00100000:1.0:1787430933.688711:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841527808 00000100:00100000:0.0:1787430933.688781:0:16487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841527936 00000100:00100000:0.0:1787430933.688786:0:16487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841527936 00010000:00010000:1.0:1787430933.688834:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 24 pid: 14375 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.688835:0:16487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 24 pid: 16446 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430933.689009:0:16487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:1.0:1787430933.689020:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787430933.689026:0:16487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:2373:x1874256841527936:12345-192.168.204.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787430933.689039:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:2374:x1874256841527808:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430933.689047:0:16487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430933.689057:0:16487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 24 pid: 16446 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.689071:0:16487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 24 pid: 16446 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.689110:0:16487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a2d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a46 expref: 24 pid: 16446 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.689132:0:16487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.689138:0:16487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.689150:0:16487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.689191:0:16487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430933.689193:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430933.689201:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 23 pid: 14375 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.689215:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 23 pid: 14375 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.689250:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a2ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a4d expref: 23 pid: 14375 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.689265:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:1.0:1787430933.689270:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.689279:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.689288:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430933.689293:0:16487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+22:2373:x1874256841527936:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 270us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.689306:0:16487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00010000:00010000:2.0:1787430933.690017:0:16446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.690044:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430933.690069:0:16446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787430933.690405:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a334 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a69 expref: 23 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.690483:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430933.690702:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+22:2374:x1874256841527808:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 1668us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.690713:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00010000:00010000:2.0:1787430933.690821:0:16446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74800/0x1fa5b1e070e6a33b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a69 expref: 21 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.690834:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:2.0:1787430933.690837:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787430933.690840:0:16446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74800, rc 0) 00000100:00100000:2.0:1787430933.690872:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+21:14471:x1874256841527680:12345-192.168.204.60@tcp:101:dd.0 Request processed in 7409us (8050us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787430933.690881:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:3.0:1787430933.701244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.701616:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841528192 00000100:00100000:0.0:1787430933.701635:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841528192 00000100:00100000:0.0:1787430933.701727:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:0.0:1787430933.702067:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+21:14471:x1874256841528192:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:0.0:1787430933.702959:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.702984:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.702999:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430933.703218:0:14375:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787430933.703268:0:14375:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ca7cf2 reply state 00000000d2fa2ac8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430933.703279:0:14375:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430933.704499:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14471:x1874256841528192:12345-192.168.204.60@tcp:36:dd.0 Request processed in 2439us (3251us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787430933.704513:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000020:00080000:0.0:1787430933.704521:0:14375:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787430933.713914:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787430933.713993:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.714076:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.714086:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.714093:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.714102:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.714110:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.714525:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841528320 00000100:00100000:1.0:1787430933.714545:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841528320 00010000:00010000:3.0:1787430933.714575:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:3.0:1787430933.714580:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787430933.714586:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.714593:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a349 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.714632:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:1.0:1787430933.714647:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+23:14471:x1874256841528320:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787430933.714682:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430933.714705:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a350 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a70 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.714924:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a70 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.714966:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a70 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.714990:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:1.0:1787430933.714993:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430933.714997:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a1e00, rc 0) 00000100:00100000:1.0:1787430933.715089:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14471:x1874256841528320:12345-192.168.204.60@tcp:101:dd.0 Request processed in 445us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.715098:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:3.0:1787430933.731470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.731917:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841528576 00000100:00100000:0.0:1787430933.731948:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841528576 00000100:00100000:0.0:1787430933.732024:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787430933.732036:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14471:x1874256841528576:12345-192.168.204.60@tcp:103:dd.0 00010000:00010000:0.0:1787430933.732053:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430933.732080:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1e00/0x1fa5b1e070e6a350 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a70 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.732101:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.732106:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430933.733004:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+23:14471:x1874256841528576:12345-192.168.204.60@tcp:103:dd.0 Request processed in 961us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.733017:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:2.0:1787430933.737881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.738065:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841528704 00000100:00100000:3.0:1787430933.738075:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841528704 00000100:00100000:3.0:1787430933.738136:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:3.0:1787430933.738146:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+23:14471:x1874256841528704:12345-192.168.204.60@tcp:58:dd.0 00010000:00010000:3.0:1787430933.738254:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.738271:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.738283:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787430933.739868:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787430933.740027:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787430933.740099:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787430933.740233:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+23:14471:x1874256841528704:12345-192.168.204.60@tcp:58:dd.0 Request processed in 2083us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430933.740244:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:2.0:1787430933.744131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430933.747352:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841528832 00000100:00100000:1.0:1787430933.747367:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841528832 00000100:00100000:1.0:1787430933.747448:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:1.0:1787430933.747459:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+23:14471:x1874256841528832:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787430933.747480:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787430933.747502:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a77 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.747561:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.747572:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.747614:0:14376:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.747635:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.747648:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:1.0:1787430933.747651:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787430933.747655:0:14376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.747663:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f1c71a1c00, rc 0) 00000100:00100000:1.0:1787430933.747744:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14471:x1874256841528832:12345-192.168.204.60@tcp:101:dd.0 Request processed in 286us (3622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.747751:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000040:00080000:1.0:1787430933.916654:0:14408:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787430933.916663:0:14408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430933.916708:0:14408:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787430933.916715:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787430933.916837:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14408:1874256856184448:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787430933.917776:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c2a60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787430933.923034:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14408:1874256856184448:192.168.204.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787430933.924708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430933.924805:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841528960 00000100:00100000:1.0:1787430933.924814:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841528960 00000100:00100000:1.0:1787430933.924932:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787430933.924943:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841528960:12345-192.168.204.60@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787430933.925039:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841528960:12345-192.168.204.60@tcp:900:lhsmtool_posix.0 Request processed in 98us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.925048:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:2.0:1787430933.930635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.930728:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841529088 00000100:00100000:0.0:1787430933.930748:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841529088 00000100:00100000:0.0:1787430933.930801:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:0.0:1787430933.930811:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841529088:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430933.930847:0:14375:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430933.930995:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841529088:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 184us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.931003:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:3.0:1787430933.936233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430933.939714:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841529216 00000100:00100000:1.0:1787430933.939730:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841529216 00000100:00100000:1.0:1787430933.939802:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:1.0:1787430933.939811:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841529216:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787430933.939888:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939906:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939917:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939953:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939961:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939969:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939989:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.939997:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940020:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787430933.940056:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787430933.940060:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787430933.940074:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940085:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940092:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940099:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940105:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a1a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430933.940109:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940116:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940127:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2daf05500) 00010000:00010000:1.0:1787430933.940130:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430933.940134:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940140:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a365 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940172:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940179:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940186:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940192:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a0200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430933.940195:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940200:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940208:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa0f2c65a8d00) 00010000:00010000:1.0:1787430933.940210:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430933.940213:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940219:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a36c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940235:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940241:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940247:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940257:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a1800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430933.940260:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940266:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940272:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:1.0:1787430933.940274:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430933.940277:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.940283:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a373 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.940392:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841529216:12345-192.168.204.60@tcp:34:lhsmtool_posix.0 Request processed in 580us (4168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430933.940400:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:3.0:1787430933.943466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.943726:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841529472 00000100:00100000:0.0:1787430933.943735:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841529472 00000100:00100000:0.0:1787430933.943792:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:0.0:1787430933.943820:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+24:14472:x1874256841529472:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430933.943839:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.943861:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a37a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a7e expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.943954:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.943994:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944006:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787430933.944030:0:14375:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787430933.944447:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944455:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944462:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944468:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262400 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430933.944472:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944479:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944491:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430933.944494:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787430933.944498:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944504:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262400/0x1fa5b1e070e6a381 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944549:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a37a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a7e expref: 26 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944567:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0f2daf05500) 00010000:00010000:0.0:1787430933.944570:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787430933.944575:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263800/0x1fa5b1e070e6a37a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a7e expref: 26 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.944585:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263800, rc 0) 00000100:00100000:0.0:1787430933.944647:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+25:14472:x1874256841529472:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 836us (1190us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787430933.944653:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:2.0:1787430933.951460:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.951887:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841529600 00000100:00100000:0.0:1787430933.951898:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841529600 00000100:00100000:0.0:1787430933.952665:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:0.0:1787430933.952678:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+25:14472:x1874256841529600:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787430933.952713:0:16446:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787430933.952833:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+25:14472:x1874256841529600:12345-192.168.204.60@tcp:53:lhsmtool_posix.0 Request processed in 157us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.952840:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787430933.957722:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.957903:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841529856 00000100:00100000:2.0:1787430933.957932:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841529856 00000100:00100000:2.0:1787430933.957986:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:2.0:1787430933.957999:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+25:14472:x1874256841529856:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430933.958018:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430933.958039:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e6a38f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a85 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787430933.958794:0:14377:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1787430933.958802:0:14377:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787430933.958849:0:14377:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787430933.959852:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e6a396 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.959882:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e6a396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.959894:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e6a396 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.959962:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75600/0x1fa5b1e070e6a38f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a85 expref: 28 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.959980:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e6a396 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a85 expref: 27 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.959989:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2d22f0400) 00010000:00010000:2.0:1787430933.959992:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787430933.959995:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74200, rc 0) 00000100:00100000:2.0:1787430933.960068:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+27:14472:x1874256841529856:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 2073us (2353us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787430933.960084:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:3.0:1787430933.963314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430933.963625:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841530112 00000100:00100000:1.0:1787430933.963634:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841530112 00000100:00100000:1.0:1787430933.963685:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:1.0:1787430933.963694:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+27:14472:x1874256841530112:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430933.963755:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430933.963778:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74200/0x1fa5b1e070e6a396 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a85 expref: 27 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963796:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2d22f0400) 00010000:00010000:1.0:1787430933.963805:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787430933.963837:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963849:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963858:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963870:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963877:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963884:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963952:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963958:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963963:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963968:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a1800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430933.963972:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963979:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.963997:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0f2dac6b200) 00010000:00010000:1.0:1787430933.963999:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430933.964003:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964008:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1800/0x1fa5b1e070e6a3a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964018:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964024:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964029:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964045:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a0200 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:1.0:1787430933.964048:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964054:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964060:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb976133a (ffffa0f2c65a8d00) 00010000:00010000:1.0:1787430933.964062:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787430933.964064:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.964069:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a0200/0x1fa5b1e070e6a3ab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb976133a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.964158:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+26:14472:x1874256841530112:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 465us (851us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787430933.964176:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:0.0:1787430933.967137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430933.967307:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841530240 00000100:00100000:3.0:1787430933.967317:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841530240 00000100:00100000:3.0:1787430933.967400:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:3.0:1787430933.967410:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+26:14472:x1874256841530240:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787430933.967429:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787430933.967451:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a3b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a8c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.967484:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a3b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.967497:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.967520:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14375 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.967605:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a000/0x1fa5b1e070e6a3b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a8c expref: 28 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.967622:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147bc00/0x1fa5b1e070e6a3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a8c expref: 27 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.967631:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:3.0:1787430933.967634:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787430933.967638:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c147bc00, rc 0) 00000100:00100000:3.0:1787430933.967873:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+27:14472:x1874256841530240:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 462us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430933.967880:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:3.0:1787430933.971080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430933.971148:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841530496 00000100:00100000:1.0:1787430933.971157:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841530496 00000100:00100000:1.0:1787430933.971219:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:1.0:1787430933.971228:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+27:14472:x1874256841530496:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787430933.971303:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.971319:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430933.971369:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787430933.971753:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787430933.971763:0:14376:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397526435343ns, next at 398526433237ns, rc = 0 00000004:00010000:1.0:1787430933.971841:0:14376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6e8767a reply state 00000000f8cd6091 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430933.971850:0:14376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787430933.971930:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+29:14472:x1874256841530496:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 702us (858us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787430933.971937:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00010000:00010000:3.0:1787430933.974135:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.974150:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.974158:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.974174:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f1c71a1a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:3.0:1787430933.974179:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.974204:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.974219:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:3.0:1787430933.974222:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787430933.974227:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430933.974232:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1a00/0x1fa5b1e070e6a3c0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430933.975984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.976068:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841530624 00000100:00100000:2.0:1787430933.976077:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841530624 00000100:00100000:2.0:1787430933.976127:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:2.0:1787430933.976136:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+28:14472:x1874256841530624:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430933.976157:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430933.976186:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a93 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.976238:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 29 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.976251:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 29 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.976268:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:2.0:1787430933.976271:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787430933.976274:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c75000, rc 0) 00000100:00100000:2.0:1787430933.976365:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+29:14472:x1874256841530624:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 230us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430933.976373:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:0.0:1787430933.979562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.979685:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841530752 00000100:00100000:2.0:1787430933.979693:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841530752 00000100:00100000:2.0:1787430933.979756:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:2.0:1787430933.979766:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2371:x1874256841530752:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787430933.980151:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787430933.980481:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2371:x1874256841530752:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 715us (925us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787430933.980500:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787430933.982695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.982876:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841531008 00000100:00100000:2.0:1787430933.982886:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841531008 00000100:00100000:2.0:1787430933.982940:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787430933.982949:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+29:14472:x1874256841531008:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787430933.983230:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+30:14472:x1874256841531008:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 281us (541us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787430933.983238:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:1.0:1787430933.985861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.985947:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841531264 00000100:00100000:0.0:1787430933.985956:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841531264 00000100:00100000:0.0:1787430933.986054:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:0.0:1787430933.986064:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+30:14472:x1874256841531264:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787430933.986187:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+30:14472:x1874256841531264:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 124us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.986195:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:3.0:1787430933.988083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430933.988810:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841531392 00000100:00100000:2.0:1787430933.988820:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841531392 00000100:00100000:2.0:1787430933.988877:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:2.0:1787430933.988886:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c4c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+30:14472:x1874256841531392:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787430933.988904:0:16446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787430933.988923:0:16446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e6a3ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14a9a expref: -99 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.988994:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6a3d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.989007:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6a3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.989018:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6a3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787430933.989061:0:16446:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787430933.989077:0:16446:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6a3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.989113:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75400/0x1fa5b1e070e6a3ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a9a expref: 32 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.989130:0:16446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6a3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a9a expref: 31 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430933.989138:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:2.0:1787430933.989141:0:16446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787430933.989145:0:16446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c4c74e00, rc 0) 00000100:00100000:2.0:1787430933.989209:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c4c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+31:14472:x1874256841531392:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 323us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430933.989216:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:1.0:1787430933.991555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.991653:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841531520 00000100:00100000:0.0:1787430933.991663:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841531520 00000100:00100000:0.0:1787430933.991769:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:0.0:1787430933.991782:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+6:2373:x1874256841531520:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430933.991800:0:15058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430933.991827:0:15058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14aa1 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430933.991854:0:15058:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0815, blocks: 0x1 00010000:00010000:0.0:1787430933.991887:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1787430933.991892:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430933.991902:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 7 pid: 15058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.991922:0:15058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 7 pid: 15058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430933.991936:0:15058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5263c00, rc 0) 00000100:00100000:0.0:1787430933.992014:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2373:x1874256841531520:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 235us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.992021:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787430933.997229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430933.997353:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841531776 00000100:00100000:0.0:1787430933.997368:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841531776 00000100:00100000:0.0:1787430933.997418:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:0.0:1787430933.997428:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+31:14472:x1874256841531776:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787430933.997518:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+31:14472:x1874256841531776:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430933.997526:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:1.0:1787430934.007494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430934.007787:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841531904 00000100:00100000:0.0:1787430934.007797:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841531904 00000100:00100000:0.0:1787430934.007875:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:0.0:1787430934.007887:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+31:14472:x1874256841531904:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1787430934.008031:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430934.061932:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+31:14472:x1874256841531904:12345-192.168.204.60@tcp:44:lhsmtool_posix.0 Request processed in 54036us (54437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430934.061945:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000001:00080000:0.0:1787430934.062020:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1787430934.062040:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1787430934.062047:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1787430934.062051:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787430934.062074:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1787430934.062090:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787430934.062452:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856184576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787430934.062508:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430934.062626:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856184576 00000100:00100000:1.0:1787430934.062633:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856184576 00000100:00100000:1.0:1787430934.062689:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787430934.062698:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856184576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787430934.062850:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787430934.062854:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787430934.062856:0:15056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787430934.062859:0:15056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787430933 -> 1787430933 00002000:00010000:1.0:1787430934.062861:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787430934.062902:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874256856184576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (393us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787430934.062909:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1787430934.062985:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0f2c9397b80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787430934.062992:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c9397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856184576:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787430934.063010:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787430934.066429:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430934.066557:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532032 00000100:00100000:2.0:1787430934.066566:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532032 00000100:00100000:2.0:1787430934.066625:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:2.0:1787430934.066636:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2372:x1874256841532032:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787430934.066796:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2372:x1874256841532032:12345-192.168.204.60@tcp:16:lhsmtool_posix.0 Request processed in 161us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430934.066804:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787430934.070054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430934.070366:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532288 00000100:00100000:0.0:1787430934.070377:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532288 00000100:00100000:0.0:1787430934.070437:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:0.0:1787430934.070448:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:14472:x1874256841532288:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787430934.070496:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430934.070520:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c74e00/0x1fa5b1e070e6a3d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a9a expref: 14 pid: 16446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.070556:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:0.0:1787430934.070561:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430934.070595:0:16446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.070608:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.070618:0:16446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787430934.070813:0:16446:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fef9b23 reply state 00000000daa01344 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.070823:0:16446:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787430934.070924:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+15:14472:x1874256841532288:12345-192.168.204.60@tcp:36:lhsmtool_posix.0 Request processed in 476us (877us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787430934.070931:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 52 00010000:00010000:2.0:1787430934.074568:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.074585:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.074606:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.074615:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262a00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:2.0:1787430934.074619:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.074626:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.074642:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:2.0:1787430934.074646:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787430934.074651:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.074657:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262a00/0x1fa5b1e070e6a3e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430934.075956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430934.076204:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532416 00000100:00100000:0.0:1787430934.076214:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532416 00000100:00100000:0.0:1787430934.076273:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787430934.076284:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:14472:x1874256841532416:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787430934.076301:0:15058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787430934.076318:0:15058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7dccdf659bc14aa8 expref: -99 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.076381:0:15058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.076402:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.076405:0:15058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.076409:0:15058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 8 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.076437:0:15058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.076446:0:15058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.076457:0:15058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15058:1874256856184704:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430934.076535:0:15058:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787430934.082572:0:15058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15058:1874256856184704:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430934.082610:0:15058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 8 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.082632:0:15058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0f2c5262e00, rc 0) 00000100:00100000:0.0:1787430934.082736:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+8:14472:x1874256841532416:12345-192.168.204.60@tcp:101:lhsmtool_posix.0 Request processed in 6453us (6786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430934.082745:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:3.0:1787430934.083058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430934.083113:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532544 00000100:00100000:0.0:1787430934.083120:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532544 00010000:00010000:0.0:1787430934.083181:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.083211:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:0.0:1787430934.083221:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+8:2373:x1874256841532544:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787430934.083234:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787430934.083257:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.083271:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.083305:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a3dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa1 expref: 8 pid: 15058 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.083319:0:14361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.083323:0:14361:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.083355:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 7 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.083365:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 7 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.083404:0:14361:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 7 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.083432:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14361:1874256856184832:192.168.204.60@tcp:105: 00000100:00100000:0.0:1787430934.083485:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430934.087261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430934.087371:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14361:1874256856184832:192.168.204.60@tcp:105: 00010000:00010000:0.0:1787430934.087398:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787430934.087454:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2373:x1874256841532544:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 4233us (4396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430934.087466:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:1.0:1787430934.087513:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532672 00000100:00100000:1.0:1787430934.087520:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532672 00000100:00100000:1.0:1787430934.087569:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787430934.087577:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2371:x1874256841532672:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787430934.087834:0:15057:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787430934.087837:0:15057:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787430933 00002000:00010000:1.0:1787430934.087840:0:15057:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787430932 00002000:00010000:1.0:1787430934.087842:0:15057:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787430933 -> 1787430933 00002000:00010000:1.0:1787430934.087844:0:15057:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787430934.087884:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+8:2371:x1874256841532672:12345-192.168.204.60@tcp:2:lhsmtool_posix.0 Request processed in 308us (630us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787430934.087905:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430934.090497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430934.090625:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532800 00000100:00100000:2.0:1787430934.090634:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532800 00000100:00100000:2.0:1787430934.090687:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:2.0:1787430934.090697:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c6ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+8:2374:x1874256841532800:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787430934.090840:0:16071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.090861:0:16071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 8 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.090869:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430934.090886:0:16071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787430934.090891:0:16071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.090927:0:16071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 8 pid: 15058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.090941:0:16071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 8 pid: 15058 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787430934.090958:0:16071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16071:1874256856184960:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787430934.091044:0:16071:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f4020cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787430934.094050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.094242:0:16487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841532928 00000100:00100000:1.0:1787430934.094252:0:16487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841532928 00010000:00010000:1.0:1787430934.094291:0:16487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 9 pid: 15058 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430934.094403:0:16487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:1.0:1787430934.094418:0:16487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:2373:x1874256841532928:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430934.094433:0:16487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430934.094456:0:16487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 9 pid: 15058 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.094471:0:16487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 9 pid: 15058 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.094497:0:16487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430934.094501:0:16487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787430934.094508:0:16487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.094517:0:16487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.094537:0:16487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787430934.094592:0:16487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:2373:x1874256841532928:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 175us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430934.094614:0:16487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00010000:00010000:0.0:1787430934.097405:0:16071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a3ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14aa8 expref: 8 pid: 15058 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.097428:0:16071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10b8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16071:1874256856184960:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430934.097454:0:16071:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097467:0:16071:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097474:0:16071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097509:0:16071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097537:0:16071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097545:0:16071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097552:0:16071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430934.097557:0:16071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097566:0:16071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097584:0:16071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.097591:0:16071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e625d6/0x1fa5b1e070e6a3f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.097690:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c6ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+7:2374:x1874256841532800:12345-192.168.204.60@tcp:1:lhsmtool_posix.0 Request processed in 6993us (7198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430934.097700:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:2.0:1787430934.103735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.103846:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841533184 00000100:00100000:1.0:1787430934.103857:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841533184 00000100:00100000:0.0:1787430934.105419:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:0.0:1787430934.105441:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:14472:x1874256841533184:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787430934.105540:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105557:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105568:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105806:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105817:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105826:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105858:0:14376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.105872:0:14376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 15 pid: 14377 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.105886:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14376:1874256856185088:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787430934.105971:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787430934.115867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.116116:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841533312 00000100:00100000:1.0:1787430934.116125:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841533312 00010000:00010000:1.0:1787430934.116178:0:14360:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 16 pid: 14377 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430934.116228:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787430934.116239:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+16:2373:x1874256841533312:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787430934.116255:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787430934.116262:0:14360:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 16 pid: 14377 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.116274:0:14360:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 16 pid: 14377 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.116296:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:1.0:1787430934.116300:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.116310:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.116318:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.116404:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c4c75000/0x1fa5b1e070e6a3c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a93 expref: 16 pid: 14377 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.116441:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14376:1874256856185088:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787430934.116473:0:14376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.116619:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787430934.116640:0:14376:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.116649:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430934.116725:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+15:2373:x1874256841533312:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 487us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430934.116734:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000001:00080000:0.0:1787430934.116847:0:14376:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787430934.116993:0:14376:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787430934.117038:0:14376:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787430934.117111:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14376:1874256856185216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787430934.117217:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430934.117300:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c7858300 going to sleep for 11 seconds 00000100:00100000:1.0:1787430934.118825:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856185216 00000100:00100000:1.0:1787430934.118837:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856185216 00000100:00100000:1.0:1787430934.118888:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787430934.118898:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14376:x1874256856185216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787430934.119013:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14376:x1874256856185216:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430934.119021:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787430934.119171:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14376:1874256856185216:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787430934.121392:0:14376:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787430934.121501:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14376:1874256856185344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787430934.121574:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430934.121600:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2f4020540 going to sleep for 11 seconds 00000100:00100000:1.0:1787430934.122355:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856185344 00000100:00100000:1.0:1787430934.122365:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856185344 00000100:00100000:1.0:1787430934.122472:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787430934.122483:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14376:x1874256856185344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787430934.122691:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14376:x1874256856185344:12345-0@lo:1000:mdt00_001.0 Request processed in 209us (1116us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787430934.122699:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787430934.122727:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14376:1874256856185344:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787430934.122772:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.122783:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.122792:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.122798:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430934.122803:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123109:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123238:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:0.0:1787430934.123242:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430934.123247:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123254:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262800/0x1fa5b1e070e6a3ff lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123286:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123292:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123299:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123304:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c147a800 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430934.123307:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123313:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123320:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430934.123322:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787430934.123347:0:14376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123492:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123503:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.123564:0:14376:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0f1c71a1c00/0x1fa5b1e070e6a35e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x7dccdf659bc14a77 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.123578:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14376:1874256856185472:192.168.204.60@tcp:105: 00000100:00100000:0.0:1787430934.123656:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0f2c785ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787430934.129897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430934.130248:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841533440 00000100:00100000:3.0:1787430934.130257:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841533440 00000100:00100000:3.0:1787430934.130311:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:3.0:1787430934.130321:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fdd59050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:14471:x1874256841533440:12345-192.168.204.60@tcp:49:dd.0 00000100:00100000:3.0:1787430934.130494:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fdd59050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+19:14471:x1874256841533440:12345-192.168.204.60@tcp:49:dd.0 Request processed in 173us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430934.130517:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787430934.130702:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f1c10c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14376:1874256856185472:192.168.204.60@tcp:105: 00010000:00010000:0.0:1787430934.130729:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130740:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c147a800/0x1fa5b1e070e6a357 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130775:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130789:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130800:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130809:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130821:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130828:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130834:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430934.130837:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130845:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130856:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430934.130859:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787430934.130862:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130869:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5262e00/0x1fa5b1e070e6a406 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130880:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130887:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130893:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130898:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc1fe84f0) 00010000:00010000:0.0:1787430934.130906:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130912:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130919:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0f2dac6b100) 00010000:00010000:0.0:1787430934.130922:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787430934.130924:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.130930:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f2c5263c00/0x1fa5b1e070e6a3f8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.131126:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+18:14472:x1874256841533184:12345-192.168.204.60@tcp:57:lhsmtool_posix.0 Request processed in 25694us (27401us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787430934.131136:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00000020:00080000:0.0:1787430934.131140:0:14376:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787430934.131836:0:14408:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787430934.131843:0:14408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787430934.131873:0:14408:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787430934.131879:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787430934.136081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430934.136237:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841533696 00000100:00100000:3.0:1787430934.136247:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841533696 00000100:00100000:3.0:1787430934.136578:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:3.0:1787430934.136589:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+18:14472:x1874256841533696:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787430934.137493:0:14379:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787430934.137604:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787430934.137645:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.137662:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.137674:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.137682:0:14379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.137689:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.137695:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.137723:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787430934.137819:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c35fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+20:14472:x1874256841533696:12345-192.168.204.60@tcp:35:lhsmtool_posix.0 Request processed in 1230us (1744us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787430934.137828:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000020:00080000:3.0:1787430934.137840:0:14379:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787430934.137850:0:16486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787430934.137856:0:16486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.137864:0:16486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d600 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:2.0:1787430934.137868:0:16486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.137946:0:16486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.137959:0:16486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0f2daf05300) 00010000:00010000:2.0:1787430934.137962:0:16486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787430934.137967:0:16486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.137973:0:16486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0f30216d600/0x1fa5b1e070e6a40d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.137984:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430934.137986:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787430934.137988:0:16486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787430934.271045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.271094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430934.271483:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841533824 00000100:00100000:2.0:1787430934.271494:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841533824 00000100:00100000:2.0:1787430934.271668:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841533952 00000100:00100000:2.0:1787430934.271672:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841533952 00000100:00100000:2.0:1787430934.271699:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:2.0:1787430934.271709:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+8:2372:x1874256841533824:12345-192.168.204.60@tcp:4:dd.0 00002000:00010000:2.0:1787430934.271758:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8a0815, atime: 0x6a8a0814, ctime: 0x6a8a0815, blocks: 0x1 00010000:00010000:2.0:1787430934.271769:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.271785:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787430934.271790:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787430934.271797:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787430934.271833:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430934.273131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430934.273187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787430934.273293:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787430934.273303:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787430934.274630:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787430934.274654:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534080 00000100:00100000:1.0:1787430934.274664:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534080 00000100:00100000:1.0:1787430934.274711:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787430934.274717:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534208 00000100:00100000:1.0:1787430934.274727:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534208 00000100:00100000:3.0:1787430934.276045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.276147:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787430934.276170:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534336 00000100:00100000:1.0:1787430934.276177:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534336 00000100:00100000:0.0:1787430934.277597:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:0.0:1787430934.277611:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+12:2371:x1874256841533952:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:0.0:1787430934.277656:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.277673:0:16601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.277678:0:16601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.277684:0:16601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.277707:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430934.280374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.280698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787430934.280736:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787430934.280746:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787430934.283105:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787430934.283122:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534592 00000100:00100000:3.0:1787430934.283132:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534592 00000100:00100000:1.0:1787430934.284807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430934.285100:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534464 00000100:00100000:2.0:1787430934.285109:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534464 00000100:00100000:2.0:1787430934.285174:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787430934.285182:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534720 00000100:00100000:2.0:1787430934.285184:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534720 00000100:00100000:3.0:1787430934.288145:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:3.0:1787430934.288179:0:16602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+16:2371:x1874256841534080:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:3.0:1787430934.288225:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.288243:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430934.288247:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430934.288255:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.288271:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787430934.352980:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787430934.353000:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1787430934.353019:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1787430934.353233:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1787430934.353238:0:15063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1787430934.353255:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353268:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353277:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353283:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c4c74e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430934.353288:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353296:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353317:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353350:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000563cd229/0x1fa5b1e070e6a414 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.353460:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+18:2372:x1874256841533824:12345-192.168.204.60@tcp:4:dd.0 Request processed in 81747us (82505us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787430934.353473:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:0.0:1787430934.353517:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:0.0:1787430934.353530:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+17:2371:x1874256841534208:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:0.0:1787430934.353564:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353577:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.353581:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.353587:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.353599:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430934.414894:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1787430934.414929:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1787430934.415230:0:16601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1787430934.415236:0:16601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:3.0:1787430934.415261:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.415290:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.415300:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.415307:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263c00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430934.415312:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.415323:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787430934.416176:0:16602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787430934.416194:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416206:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416215:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416237:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216d200 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430934.416241:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416250:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416271:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416279:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004321e935/0x1fa5b1e070e6a422 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.416402:0:16602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+15:2371:x1874256841534080:12345-192.168.204.60@tcp:4:dd.0 Request processed in 128238us (143273us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787430934.416411:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787430934.416448:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:0.0:1787430934.416460:0:16602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:2371:x1874256841534336:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:0.0:1787430934.416495:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416508:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.416513:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.416519:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.416542:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.416880:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.416889:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaccc4c3/0x1fa5b1e070e6a41b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430934.416956:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:2371:x1874256841533952:12345-192.168.204.60@tcp:4:dd.0 Request processed in 139347us (145860us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787430934.416964:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:3.0:1787430934.416984:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:3.0:1787430934.416992:0:16601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+13:2372:x1874256841534464:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:3.0:1787430934.417008:0:16601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.417024:0:16601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430934.417027:0:16601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787430934.417032:0:16601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.417041:0:16601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787430934.441781:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1787430934.441871:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:0.0:1787430934.441887:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.441900:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.441909:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.441916:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430934.441923:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.441931:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.441953:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.441965:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a429 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.442073:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+15:2371:x1874256841534208:12345-192.168.204.60@tcp:4:dd.0 Request processed in 88543us (168881us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787430934.442083:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:0.0:1787430934.442114:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:0.0:1787430934.442127:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+14:2371:x1874256841534720:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:0.0:1787430934.442451:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.442464:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.442470:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.442477:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.442491:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787430934.474623:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1787430934.474661:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1787430934.474746:0:16602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1787430934.474752:0:16602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1787430934.474769:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.474786:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.474797:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.474804:0:16601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.474818:0:16601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.474836:0:16601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.474836:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5263800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:0.0:1787430934.474844:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.474847:0:16601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f30216c000 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:3.0:1787430934.474853:0:16601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.474862:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.474865:0:16601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.475477:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.475484:0:16601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.475492:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8895328/0x1fa5b1e070e6a430 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787430934.475518:0:16601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f490100/0x1fa5b1e070e6a437 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787430934.475607:0:16602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+11:2371:x1874256841534336:12345-192.168.204.60@tcp:4:dd.0 Request processed in 59145us (199564us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787430934.475618:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:0.0:1787430934.475653:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:0.0:1787430934.475666:0:16602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+10:2372:x1874256841534592:12345-192.168.204.60@tcp:4:dd.0 00010000:00010000:0.0:1787430934.475699:0:16602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787430934.475712:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787430934.475716:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787430934.475723:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787430934.475734:0:16601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+10:2372:x1874256841534464:12345-192.168.204.60@tcp:4:dd.0 Request processed in 58738us (195032us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787430934.475755:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00010000:00010000:0.0:1787430934.475759:0:16602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787430934.533195:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1787430934.535782:0:15063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1787430934.535805:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.535820:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.535830:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.535837:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262e00 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430934.535842:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.535851:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.535888:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.535896:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aadd1703/0x1fa5b1e070e6a43e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430934.536002:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+9:2371:x1874256841534720:12345-192.168.204.60@tcp:4:dd.0 Request processed in 93874us (251198us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787430934.536018:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000001:00080000:0.0:1787430934.571477:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1787430934.571666:0:16602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.571681:0:16602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.571692:0:16602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.571699:0:16602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0f2c5262800 already unused, calling callback (ffffffffc15a9230) 00010000:00010000:1.0:1787430934.571704:0:16602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.571713:0:16602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.571753:0:16602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787430934.571761:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeee74b2/0x1fa5b1e070e6a445 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787430934.571865:0:16602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2c9394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2372:x1874256841534592:12345-192.168.204.60@tcp:4:dd.0 Request processed in 96199us (291497us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787430934.571876:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00010000:00010000:2.0:1787430934.687875:0:14363:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787430934.748649:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430934.748674:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856185600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787430934.748747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430934.748775:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856185728:0@lo:400:kworker.0 00000100:00100000:0.0:1787430934.748813:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856185984:0@lo:400:kworker.0 00000100:00100000:1.0:1787430934.748838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430934.748850:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430934.748876:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856186240:0@lo:400:kworker.0 00000100:00100000:0.0:1787430934.748878:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787430934.748888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856186112:0@lo:400:kworker.0 00000100:00100000:1.0:1787430934.748919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430934.748936:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856185600 00000100:00100000:0.0:1787430934.748944:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856185600 00000100:00100000:1.0:1787430934.748948:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787430934.748956:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856185856:0@lo:400:kworker.0 00000100:00100000:1.0:1787430934.748985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787430934.748992:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787430934.749003:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856185600:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787430934.749007:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2ec22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856186368:0@lo:400:kworker.0 00002000:00000024:0.0:1787430934.749027:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1787430934.749034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787430934.749069:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856185728 00000100:00100000:1.0:1787430934.749073:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856185728 00000100:00100000:0.0:1787430934.749075:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856185600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430934.749084:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787430934.749109:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787430934.749110:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856185984 00000100:00100000:0.0:1787430934.749116:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856185984 00000100:00100000:1.0:1787430934.749121:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2e5b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3307:x1874256856185728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430934.749167:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856185856 00000100:00100000:0.0:1787430934.749171:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856185856 00000100:00100000:1.0:1787430934.749186:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2e5b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec3bb70-eba8-428d-9804-5196e7d74be3+19:3307:x1874256856185728:12345-0@lo:400:kworker.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430934.749196:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787430934.749206:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f1c10cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856185984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787430934.749214:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787430934.749261:0:16454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787430934.749262:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f1c10cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874256856185984:12345-0@lo:400:kworker.0 Request processed in 56us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430934.749273:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787430934.749278:0:16454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856185856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787430934.749298:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856186240 00000100:00100000:0.0:1787430934.749303:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856186240 00000100:00100000:1.0:1787430934.749319:0:16454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1874256856185856:12345-0@lo:400:kworker.0 Request processed in 47us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430934.749346:0:16454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787430934.749379:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787430934.749384:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0f2c9397b80, transno 8589934595 00000004:00080000:1.0:1787430934.749394:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787430934.749416:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1874256856185856:0@lo:400:kworker.0 00000100:00100000:1.0:1787430934.749430:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec3bb70-eba8-428d-9804-5196e7d74be3:3307:1874256856185728:0@lo:400:kworker.0 00000100:00100000:0.0:1787430934.749481:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856186368 00000100:00100000:0.0:1787430934.749485:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856186368 00000100:00100000:2.0:1787430934.749584:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787430934.749594:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0f2c35fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787430934.749623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787430934.749660:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787430934.749665:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787430934.749675:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787430934.757931:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856185984:0@lo:400:kworker.0 00000100:00100000:2.0:1787430934.757959:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1874256856185600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787430934.758004:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856186496 00000100:00100000:2.0:1787430934.758010:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856186496 00000100:00100000:2.0:1787430934.758069:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430934.758077:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856186496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787430934.758109:0:15060:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787430934.758184:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874256856186496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (8560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430934.758191:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787430934.758238:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2c35fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1874256856186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787430934.758362:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256856186112 00000100:00100000:3.0:1787430934.758367:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256856186112 00000100:00100000:3.0:1787430934.758394:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430934.758402:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856186240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430934.758453:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874256856186240:12345-0@lo:400:kworker.0 Request processed in 52us (9534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430934.758459:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787430934.758488:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1874256856186240:0@lo:400:kworker.0 00000100:00100000:3.0:1787430934.758507:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787430934.758514:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2ec22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856186368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430934.758549:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2ec22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874256856186368:12345-0@lo:400:kworker.0 Request processed in 36us (9515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430934.758555:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787430934.758581:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1874256856186368:0@lo:400:kworker.0 00000100:00100000:3.0:1787430934.758598:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787430934.758604:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856186112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787430934.758636:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874256856186112:12345-0@lo:400:kworker.0 Request processed in 32us (8960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430934.758650:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787430934.758676:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0f2ec22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874256856186112:0@lo:400:kworker.0 00000100:00100000:2.0:1787430935.069698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430935.069743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430935.069779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430935.069826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787430935.069860:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534848 00000100:00100000:2.0:1787430935.069870:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534848 00000100:00100000:2.0:1787430935.069920:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:2.0:1787430935.069930:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f7d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:2374:x1874256841534848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787430935.070001:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f7d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10bf22de-8fca-4146-bbff-81081a3cfdf0+13:2374:x1874256841534848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787430935.070009:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 119 00000100:00100000:0.0:1787430935.070108:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841535232 00000100:00100000:0.0:1787430935.070112:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841535232 00000100:00100000:0.0:1787430935.070170:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841535488 00000100:00100000:0.0:1787430935.070174:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841535488 00000100:00100000:0.0:1787430935.070197:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787430935.070205:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2374:x1874256841535232:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430935.070238:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2374:x1874256841535232:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.070245:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787430935.070257:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:0.0:1787430935.070263:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2374:x1874256841535488:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787430935.070287:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2374:x1874256841535488:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787430935.070293:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787430935.070481:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841534976 00000100:00100000:3.0:1787430935.070486:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841534976 00000100:00100000:3.0:1787430935.070525:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:3.0:1787430935.070532:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2fe05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+20:2374:x1874256841534976:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430935.070569:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2fe05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+20:2374:x1874256841534976:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.070576:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:3.0:1787430935.071439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430935.071543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430935.071567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787430935.071590:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841535104 00000100:00100000:3.0:1787430935.071595:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841535104 00000100:00100000:3.0:1787430935.071620:0:16071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841535616 00000100:00100000:3.0:1787430935.071623:0:16071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841535616 00000100:00100000:3.0:1787430935.071645:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:3.0:1787430935.071653:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2374:x1874256841535104:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430935.071695:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeb368b9-740b-4f2b-bbb3-3252d41bdc70+5:2374:x1874256841535104:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.071701:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:3.0:1787430935.071714:0:16071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787430935.071721:0:16071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2374:x1874256841535616:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787430935.071745:0:16071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1b61aeb-d968-445f-98a2-5f2b7302c59a+5:2374:x1874256841535616:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787430935.071779:0:16071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00080000:2.0:1787430935.072006:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787430935.072011:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787430935.072403:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874256841535360 00000100:00100000:1.0:1787430935.072408:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874256841535360 00000100:00100000:1.0:1787430935.072465:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:1.0:1787430935.072474:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0f2f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2374:x1874256841535360:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:2.0:1787430935.072524:0:14371:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787430935.072527:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0f2f73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1b61aeb-d968-445f-98a2-5f2b7302c59a+6:2374:x1874256841535360:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 53us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787430935.072536:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000001:02000400:1.0:1787430935.621218:0:16639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787430935.708692:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28320 lines, 28320 kept, 0 dropped, 0 bad.